Nov 05 11:48:38 devstack cinder-volume[75646]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 11:48:38 devstack cinder-volume[75646]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 11:48:38 devstack cinder-volume[75646]: we strongly recommend against using it for new projects. Nov 05 11:48:38 devstack cinder-volume[75646]: If you are already using Eventlet, we recommend migrating to a different Nov 05 11:48:38 devstack cinder-volume[75646]: framework. For more detail see Nov 05 11:48:38 devstack cinder-volume[75646]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 11:48:38 devstack cinder-volume[75646]: import eventlet # noqa Nov 05 11:48:41 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 11:48:41 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 11:48:41 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 11:48:42 devstack cinder-volume[75646]: INFO dbcounter [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Registered counter for database cinder Nov 05 11:48:42 devstack cinder-volume[75646]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:48:42 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writer thread running {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 11:48:42 devstack cinder-volume[75646]: INFO cinder.rpc [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 11:48:42 devstack cinder-volume[75646]: INFO cinder.rpc [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 11:48:42 devstack cinder-volume[75646]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:48:43 devstack cinder-volume[75646]: INFO cinder.volume.manager [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Determined volume DB was empty at startup. Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG cinder.volume.manager [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75646) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 11:48:43 devstack cinder-volume[75646]: INFO cinder.volume.manager [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 11:48:43 devstack cinder-volume[75646]: WARNING stevedore.named [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 11:48:43 devstack cinder-volume[75646]: WARNING castellan.key_manager [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 11:48:43 devstack cinder-volume[75646]: WARNING cinder.keymgr.conf_key_mgr [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG cinder.volume.drivers.lvm [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75646) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_concurrency.processutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] CMD "cinder-rtstool verify" returned: 0 in 0.391s {{(pid=75646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:48:43 devstack cinder-volume[75646]: INFO cinder.rpc [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 11:48:43 devstack cinder-volume[75646]: INFO cinder.rpc [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 11:48:43 devstack cinder-volume[75646]: WARNING stevedore.named [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 11:48:43 devstack cinder-volume[75646]: WARNING castellan.key_manager [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 11:48:43 devstack cinder-volume[75646]: INFO cinder.volume.manager [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:48:43 devstack cinder-volume[75646]: INFO oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Starting 1 workers Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Started child 75794 {{(pid=75646) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Full set of CONF: {{(pid=75646) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] ******************************************************************************** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Configuration options gathered from: {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] ================================================================================ {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] allow_availability_zone_fallback = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] allow_compression_on_image_upload = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75794]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] allowed_direct_url_schemes = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] api_rate_limit = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] auth_strategy = keystone {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] az_cache_duration = 3600 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_availability_zone = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_host = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_stats_polling_interval = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backup_api_class = cinder.backup.api.API {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backup_name_template = backup-%s {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backup_use_same_host = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backup_use_temp_snapshot = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] chap_password = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] chap_username = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_internal_tenant_project_id = cc3c683a11e540bd9580b91b77ad8aee {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_internal_tenant_user_id = aebdf04522594e83b64b1d030bfb45bc {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cloned_volume_same_az = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cluster = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] compression_format = gzip {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] compute_api_class = cinder.compute.nova.API {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] config_dir = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] config_source = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] control_exchange = openstack {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] debug = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] default_availability_zone = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] default_group_type = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] default_volume_type = lvmdriver-1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] disk_geometry = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] driver_client_cert = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] driver_client_cert_key = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] driver_data_namespace = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] driver_ssl_cert_path = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] driver_ssl_cert_verify = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] driver_use_ssl = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] enable_force_upload = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] enable_new_services = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] enable_unsupported_driver = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] enforce_multipath_for_image_xfer = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] filter_function = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_api_insecure = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_api_ssl_compression = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_ca_certificates_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_catalog_info = image:glance:publicURL {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_num_retries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance_request_timeout = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] goodness_function = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] graceful_shutdown_timeout = 5 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] group_api_class = cinder.group.api.API {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] host = devstack {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_compress_on_upload = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_conversion_address_space_limit = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_conversion_cpu_limit = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_conversion_disable = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_introspection_address_space_limit = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_introspection_cpu_limit = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_upload_use_cinder_backend = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_upload_use_internal_tenant = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_volume_cache_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_volume_cache_max_count = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] image_volume_cache_max_size_gb = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] init_host_max_objects_retrieval = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] instance_format = [instance: %(uuid)s] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] iscsi_target_flags = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] iscsi_write_cache = on {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] iser_helper = tgtadm {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] iser_ip_address = 192.168.122.211 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] iser_port = 3260 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_color = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_config_append = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_dir = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_options = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_rotate_interval = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_rotate_interval_type = days {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] log_rotation_type = none {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] max_age = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] max_logfile_count = 30 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] max_logfile_size_mb = 200 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] max_over_subscription_ratio = 20.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] message_reap_interval = 86400 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] message_ttl = 2592000 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] migration_create_volume_timeout_secs = 300 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] monkey_patch = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] monkey_patch_modules = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] my_ip = 192.168.122.211 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] no_snapshot_gb_quota = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] num_iser_scan_tries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] num_shell_tries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] num_volume_device_scan_tries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] nvmeof_conn_info_version = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] nvmet_ns_id = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] nvmet_port_id = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] osapi_max_limit = 1000 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] osapi_volume_ext_list = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] osapi_volume_listen_port = 8776 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] osapi_volume_use_ssl = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] osapi_volume_workers = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] per_volume_size_limit = -1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] periodic_fuzzy_delay = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] periodic_interval = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] public_endpoint = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] publish_errors = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] quota_backup_gigabytes = 1000 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] quota_backups = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] quota_gigabytes = 1000 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] quota_groups = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] quota_snapshots = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] quota_volumes = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] rate_limit_burst = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] rate_limit_except_level = CRITICAL {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] rate_limit_interval = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] reinit_driver_count = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] replication_device = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] report_discard_supported = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] report_interval = 120 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] reservation_clean_interval = 86400 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] reservation_expire = 86400 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] reserved_image_namespaces = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] reserved_percentage = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] rpc_response_timeout = 120 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] run_external_periodic_tasks = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] scst_target_driver = iscsi {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] scst_target_iqn_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_down_time = 720 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] shell_completion = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] snapshot_name_template = snapshot-%s {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] snapshot_same_host = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] split_loggers = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] state_path = /opt/stack/data/cinder {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] storage_availability_zone = nova {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] storage_protocol = iSCSI {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] syslog_log_facility = LOG_USER {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] target_helper = lioadm {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] target_ip_address = 192.168.122.211 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] target_port = 3260 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] target_protocol = iscsi {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] target_secondary_ip_addresses = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] trace_flags = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] transport_url = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] until_refresh = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] use_chap_auth = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] use_default_quota_class = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] use_journal = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] use_json = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] use_multipath_for_image_xfer = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] use_stderr = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] use_syslog = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] verify_glance_signatures = enabled {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_api_class = cinder.volume.api.API {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_backend_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_clear = zero {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_clear_ionice = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_clear_size = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_copy_bps_limit = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_dd_blocksize = 1M {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_name_template = volume-%s {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_service_inithost_offload = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volume_usage_audit_period = month {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] zoning_mode = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_concurrency.disable_process_locking = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.auth_section = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.auth_type = password {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.auth_version = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.cache = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.include_service_catalog = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.insecure = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.interface = public {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_password = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcache_username = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.region_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.service_type = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.backend = dogpile.cache.null {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.backend_argument = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.backend_expiration_time = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.config_prefix = cache.oslo {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.debug_cache_backend = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.enable_retry_client = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.enable_socket_keepalive = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.expiration_time = 600 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.hashclient_retry_attempts = 2 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.memcache_dead_retry = 300 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.memcache_pool_maxsize = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.memcache_sasl_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.password = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.proxies = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.redis_db = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.redis_server = localhost:6379 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.retry_attempts = 2 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.retry_delay = 0.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.socket_keepalive_count = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.socket_keepalive_idle = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.socket_keepalive_interval = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.socket_timeout = 1.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.tls_allowed_ciphers = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.tls_cafile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.tls_certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.tls_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.tls_keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cache.username = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] coordination.backend_url = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.asyncio_connection = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.asyncio_slave_connection = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.backend = sqlalchemy {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.connection = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.connection_debug = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.connection_parameters = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.connection_recycle_time = 3600 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.connection_trace = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.db_inc_retry_interval = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.db_max_retries = 20 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.db_max_retry_interval = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.db_retry_interval = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.max_overflow = 50 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.max_pool_size = 5 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.max_retries = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.mysql_wsrep_sync_wait = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.pool_timeout = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.retry_interval = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.slave_connection = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.sqlite_synchronous = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.synchronous_reader = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] database.use_db_reconnect = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_tracing.insecure = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.connection_string = messaging:// {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.es_doc_type = notification {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.es_scroll_size = 10000 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.es_scroll_time = 2m {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.filter_error_trace = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.hmac_keys = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.sentinel_service_name = mymaster {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.socket_timeout = 0.1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.trace_requests = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler.trace_sqlalchemy = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler_jaeger.process_tags = {} {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler_jaeger.service_name_prefix = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] profiler_otlp.service_name_prefix = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.enforce_new_defaults = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.policy_default_rule = default {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.policy_file = policy.yaml {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] privsep_osbrick.group = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] privsep_osbrick.helper_command = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] privsep_osbrick.user = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_sys_admin.group = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_sys_admin.helper_command = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] cinder_sys_admin.user = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.auth_section = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.auth_type = password {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.cafile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.collect_timing = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.insecure = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.send_service_user_token = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.split_loggers = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.timeout = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.tls_ciphers = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.063s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] service_user.tls_min_version = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.auth_section = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.auth_type = password {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.collect_timing = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.insecure = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.region_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.split_loggers = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.timeout = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.tls_ciphers = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] glance.tls_min_version = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.backend_availability_zone = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.chap_password = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.chap_username = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.disk_geometry = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.driver_client_cert = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.driver_client_cert_key = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.driver_data_namespace = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.driver_use_ssl = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.extra_capabilities = {} {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.filter_function = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.goodness_function = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.iscsi_target_flags = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.iscsi_write_cache = on {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.iser_helper = tgtadm {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.iser_port = 3260 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.lvm_share_target = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.lvm_type = auto {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.num_shell_tries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:43 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.replication_device = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.report_discard_supported = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.reserved_percentage = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack sudo[75798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 11:48:44 devstack sudo[75798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.target_helper = tgtadm {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.target_port = 3260 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.target_protocol = iscsi {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.trace_flags = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.unique_fqdn_network = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.use_chap_auth = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_backend_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_clear = zero {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_clear_ionice = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_clear_size = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_reports.file_event_handler = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_reports.log_dir = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.backend_host = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.chap_password = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.chap_username = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.disk_geometry = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.driver_client_cert = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.extra_capabilities = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.filter_function = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.goodness_function = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.iser_helper = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.iser_ip_address = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.iser_port = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.lvm_share_target = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.lvm_type = auto {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.num_shell_tries = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.replication_device = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.report_discard_supported = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.reserved_percentage = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.scst_target_driver = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.storage_protocol = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.target_helper = lioadm {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.target_ip_address = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.target_port = 3260 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.trace_flags = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.use_chap_auth = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_clear = zero {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_clear_size = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] lvmdriver-1.volumes_dir = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.ssl = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_notifications.driver = [] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_notifications.retry = -1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] key_manager.fixed_key = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.barbican_api_version = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.barbican_endpoint = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.barbican_endpoint_type = public {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.barbican_region_name = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.cafile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.collect_timing = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.insecure = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.number_of_retries = 60 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.retry_delay = 1 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.send_service_user_token = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.split_loggers = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.timeout = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.tls_ciphers = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.tls_min_version = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.verify_ssl = True {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican.verify_ssl_path = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.auth_section = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.auth_type = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.cafile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.certfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.collect_timing = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.insecure = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.keyfile = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.split_loggers = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.timeout = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.tls_ciphers = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] barbican_service_user.tls_min_version = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.approle_role_id = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.approle_secret_id = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.auth_method = approle {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.auth_path = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.kv_mountpoint = secret {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.kv_path = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.kv_version = 2 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.namespace = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.root_token_id = **** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.ssl_ca_crt_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.timeout = 60.0 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.token_file = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.token_role = None {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.use_ssl = False {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:48:44 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] ******************************************************************************** {{(pid=75646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 11:48:44 devstack sudo[75798]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.354s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:44 devstack sudo[75956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:44 devstack sudo[75956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:44 devstack sudo[75956]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.298s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:48:44 devstack cinder-volume[75794]: INFO cinder.brick.local_dev.lvm [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:44 devstack sudo[76084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:48:44 devstack sudo[76084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:44 devstack sudo[76084]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG cinder.brick.local_dev.lvm [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75794) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 11:48:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:44 devstack sudo[76190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:44 devstack sudo[76190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:46 devstack sudo[76190]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.547s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:46 devstack sudo[76525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:46 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:46 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:46 devstack sudo[76576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 11:48:46 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:47 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.292s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:47 devstack sudo[76579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:48:47 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:47 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:47 devstack sudo[76582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:48:47 devstack sudo[76582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:47 devstack sudo[76582]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:47 devstack sudo[76586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:48:47 devstack sudo[76586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:47 devstack sudo[76586]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:47 devstack sudo[76595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:47 devstack sudo[76595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:48 devstack sudo[76595]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:48 devstack sudo[76599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:48 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:48 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:48 devstack cinder-volume[75794]: INFO cinder.volume.drivers.lvm [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:48 devstack sudo[76603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:48 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:48 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:48 devstack sudo[76607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:48:48 devstack sudo[76607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:48 devstack sudo[76607]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:49 devstack sudo[76611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:48:49 devstack sudo[76611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:49 devstack sudo[76611]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:49 devstack sudo[76614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:49 devstack sudo[76614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:49 devstack sudo[76614]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:49 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:48:49 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:49 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:49 devstack cinder-volume[75794]: INFO cinder.volume.driver [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG cinder.volume.driver [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75794) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG oslo_db.sqlalchemy.engines [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75794) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writer thread running {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG cinder.db.api [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Building query based on filter {{(pid=75794) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG cinder.image.image_utils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75794) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 11:48:49 devstack cinder-volume[75794]: INFO cinder.keymgr.migration [None req-6f854f36-b144-417e-8d67-b316434989a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 11:48:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:49 devstack sudo[76621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:48:49 devstack sudo[76621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:50 devstack sudo[76621]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:50 devstack sudo[76626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:48:50 devstack sudo[76626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:50 devstack sudo[76626]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:50 devstack sudo[76629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:50 devstack sudo[76629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:50 devstack sudo[76629]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:50 devstack sudo[76632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:48:50 devstack sudo[76632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:51 devstack sudo[76632]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:48:51 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Driver initialization completed successfully. Nov 05 11:48:51 devstack cinder-volume[75794]: INFO cinder.manager [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Initiating service 2 cleanup Nov 05 11:48:51 devstack cinder-volume[75794]: INFO cinder.manager [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Service 2 cleanup completed. Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG cinder.service [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Creating RPC server for service cinder-volume {{(pid=75794) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG cinder.service [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75794) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 11:48:51 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:51 devstack sudo[76638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:48:51 devstack sudo[76638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:51 devstack sudo[76638]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:51 devstack sudo[76641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:48:51 devstack sudo[76641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:51 devstack sudo[76641]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:51 devstack sudo[76648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:48:51 devstack sudo[76648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:52 devstack sudo[76648]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:52 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.356s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:52 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:48:52 devstack sudo[76653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:48:52 devstack sudo[76653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:48:52 devstack sudo[76653]: pam_unix(sudo:session): session closed for user root Nov 05 11:48:52 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:48:52 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-1a3d1a51-3a34-4000-9582-f41d4f533a53 None None] Driver post RPC initialization completed successfully. Nov 05 11:48:53 devstack cinder-volume[75646]: DEBUG dbcounter [-] [75646] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:49:02 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:49:02 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:49:07 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:49:07 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:49:07 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread info: [<_MainThread(MainThread, started 124403558830208)>, , , , , ] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:50:07 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:50:07 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 11:50:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:50:07 devstack sudo[79198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:50:07 devstack sudo[79198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:50:07 devstack sudo[79198]: pam_unix(sudo:session): session closed for user root Nov 05 11:50:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:50:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:50:07 devstack sudo[79201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:50:07 devstack sudo[79201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:50:08 devstack sudo[79201]: pam_unix(sudo:session): session closed for user root Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:50:08 devstack sudo[79210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:50:08 devstack sudo[79210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:50:08 devstack sudo[79210]: pam_unix(sudo:session): session closed for user root Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:50:08 devstack sudo[79213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:50:08 devstack sudo[79213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:50:08 devstack sudo[79213]: pam_unix(sudo:session): session closed for user root Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:50:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread info: [<_MainThread(MainThread, started 124403558830208)>, , , , , ] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:51:02 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:51:02 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:UPDATE=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:51:07 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:51:07 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 11:51:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:51:07 devstack sudo[82210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:51:07 devstack sudo[82210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:51:07 devstack sudo[82210]: pam_unix(sudo:session): session closed for user root Nov 05 11:51:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:51:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:51:07 devstack sudo[82218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:51:07 devstack sudo[82218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:51:08 devstack sudo[82218]: pam_unix(sudo:session): session closed for user root Nov 05 11:51:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:51:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:51:08 devstack sudo[82230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:51:08 devstack sudo[82230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:51:08 devstack sudo[82230]: pam_unix(sudo:session): session closed for user root Nov 05 11:51:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:51:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:51:08 devstack sudo[82240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:51:08 devstack sudo[82240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:51:08 devstack sudo[82240]: pam_unix(sudo:session): session closed for user root Nov 05 11:51:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:51:08 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:52:07 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:52:07 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 11:52:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:52:07 devstack sudo[84323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:52:07 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:52:07 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root Nov 05 11:52:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:52:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:52:07 devstack sudo[84330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:52:07 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:52:08 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:52:08 devstack sudo[84361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:52:08 devstack sudo[84361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:52:08 devstack sudo[84361]: pam_unix(sudo:session): session closed for user root Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:52:08 devstack sudo[84370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:52:08 devstack sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:52:08 devstack sudo[84370]: pam_unix(sudo:session): session closed for user root Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:52:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread info: [<_MainThread(MainThread, started 124403558830208)>, , , , , ] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:53:02 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:53:02 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:UPDATE=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:53:07 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:53:07 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 11:53:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:07 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 11:53:07 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:07 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:07 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:53:07 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:08 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:08 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 11:53:08 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:08 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:08 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 11:53:08 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:08 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:53:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-c931584c-44b6-4cb1-8eac-ecc11367b970 None None] thread info: [<_MainThread(MainThread, started 124403558830208)>, , , , , ] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:53:24 devstack cinder-volume[75646]: INFO oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Caught SIGTERM, stopping children Nov 05 11:53:24 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Acquiring lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 11:53:24 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Acquired lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 11:53:24 devstack cinder-volume[75646]: DEBUG oslo_concurrency.lockutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Releasing lock "singleton_lock" {{(pid=75646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 11:53:24 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Stop services. {{(pid=75646) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 11:53:24 devstack cinder-volume[75646]: DEBUG oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Killing children. {{(pid=75646) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 11:53:24 devstack cinder-volume[75646]: INFO oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Waiting on 1 children to exit Nov 05 11:53:26 devstack cinder-volume[75794]: DEBUG oslo_concurrency.lockutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Acquiring lock "singleton_lock" {{(pid=75794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 11:53:26 devstack cinder-volume[75794]: DEBUG oslo_concurrency.lockutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Acquired lock "singleton_lock" {{(pid=75794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 11:53:26 devstack cinder-volume[75794]: DEBUG oslo_concurrency.lockutils [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Releasing lock "singleton_lock" {{(pid=75794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 11:53:26 devstack cinder-volume[75794]: WARNING amqp [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 11:53:26 devstack cinder-volume[75794]: WARNING amqp [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 11:53:26 devstack cinder-volume[75646]: INFO oslo_service.backend._eventlet.service [None req-a2e7f698-f23b-4143-80f2-a87714160b7b None None] Child 75794 exited with status 0 Nov 05 11:53:26 devstack cinder-volume[85887]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 11:53:26 devstack cinder-volume[85887]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 11:53:26 devstack cinder-volume[85887]: we strongly recommend against using it for new projects. Nov 05 11:53:26 devstack cinder-volume[85887]: If you are already using Eventlet, we recommend migrating to a different Nov 05 11:53:26 devstack cinder-volume[85887]: framework. For more detail see Nov 05 11:53:26 devstack cinder-volume[85887]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 11:53:26 devstack cinder-volume[85887]: import eventlet # noqa Nov 05 11:53:28 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 11:53:28 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 11:53:28 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 11:53:29 devstack cinder-volume[85887]: INFO dbcounter [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Registered counter for database cinder Nov 05 11:53:29 devstack cinder-volume[85887]: DEBUG oslo_db.sqlalchemy.engines [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:29 devstack cinder-volume[85887]: DEBUG dbcounter [-] [85887] Writer thread running {{(pid=85887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 11:53:29 devstack cinder-volume[85887]: INFO cinder.rpc [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 11:53:29 devstack cinder-volume[85887]: INFO cinder.rpc [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_db.sqlalchemy.engines [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:30 devstack cinder-volume[85887]: INFO cinder.volume.manager [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Determined volume DB was empty at startup. Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG cinder.volume.manager [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85887) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 11:53:30 devstack cinder-volume[85887]: INFO cinder.volume.manager [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 11:53:30 devstack cinder-volume[85887]: WARNING stevedore.named [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 11:53:30 devstack cinder-volume[85887]: WARNING castellan.key_manager [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 11:53:30 devstack cinder-volume[85887]: WARNING cinder.keymgr.conf_key_mgr [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 11:53:30 devstack cinder-volume[85887]: INFO cinder.volume.manager [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_db.sqlalchemy.engines [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:30 devstack cinder-volume[85887]: INFO oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Starting 1 workers Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Started child 86108 {{(pid=85887) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Full set of CONF: {{(pid=85887) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] ******************************************************************************** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Configuration options gathered from: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] ================================================================================ {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] allow_availability_zone_fallback = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] allow_compression_on_image_upload = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] allowed_direct_url_schemes = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] api_rate_limit = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] auth_strategy = keystone {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_availability_zone = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_host = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_stats_polling_interval = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backup_api_class = cinder.backup.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backup_name_template = backup-%s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backup_use_same_host = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backup_use_temp_snapshot = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] chap_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] chap_username = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_internal_tenant_project_id = cc3c683a11e540bd9580b91b77ad8aee {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_internal_tenant_user_id = aebdf04522594e83b64b1d030bfb45bc {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cluster = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[86108]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] compression_format = gzip {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] compute_api_class = cinder.compute.nova.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] config_dir = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] config_source = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] control_exchange = openstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] debug = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] default_availability_zone = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] default_group_type = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] default_volume_type = QuobyteHD {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] disk_geometry = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] driver_client_cert = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] driver_client_cert_key = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] driver_data_namespace = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] driver_ssl_cert_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] driver_ssl_cert_verify = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] driver_use_ssl = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] enable_new_services = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] enable_unsupported_driver = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] enabled_backends = ['QuobyteHD'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] enforce_multipath_for_image_xfer = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] filter_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_api_insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_api_ssl_compression = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_ca_certificates_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_catalog_info = image:glance:publicURL {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_num_retries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance_request_timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] goodness_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] graceful_shutdown_timeout = 5 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] group_api_class = cinder.group.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] host = devstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_compress_on_upload = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_conversion_address_space_limit = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_conversion_cpu_limit = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_conversion_disable = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_introspection_address_space_limit = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_introspection_cpu_limit = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_upload_use_cinder_backend = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_upload_use_internal_tenant = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_volume_cache_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_volume_cache_max_count = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] image_volume_cache_max_size_gb = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] init_host_max_objects_retrieval = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] instance_format = [instance: %(uuid)s] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] iscsi_target_flags = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] iscsi_write_cache = on {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] iser_helper = tgtadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] iser_ip_address = 192.168.122.211 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] iser_port = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_color = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_config_append = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_dir = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_options = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_rotate_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_rotate_interval_type = days {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] log_rotation_type = none {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] max_age = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] max_logfile_count = 30 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] max_logfile_size_mb = 200 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] max_over_subscription_ratio = 20.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] message_reap_interval = 86400 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] message_ttl = 2592000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] migration_create_volume_timeout_secs = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] monkey_patch = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] monkey_patch_modules = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] my_ip = 192.168.122.211 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] no_snapshot_gb_quota = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] num_iser_scan_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] num_shell_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] num_volume_device_scan_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] nvmeof_conn_info_version = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] nvmet_ns_id = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] nvmet_port_id = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] osapi_max_limit = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] osapi_volume_ext_list = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] osapi_volume_listen_port = 8776 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] osapi_volume_use_ssl = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] osapi_volume_workers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] per_volume_size_limit = -1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] periodic_fuzzy_delay = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] periodic_interval = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] public_endpoint = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] publish_errors = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] quota_backup_gigabytes = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] quota_backups = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] quota_gigabytes = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] quota_groups = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] quota_snapshots = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] quota_volumes = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] rate_limit_burst = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] rate_limit_except_level = CRITICAL {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] rate_limit_interval = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] reinit_driver_count = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] replication_device = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] report_discard_supported = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] report_interval = 120 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] reservation_clean_interval = 86400 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] reservation_expire = 86400 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] reserved_image_namespaces = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] reserved_percentage = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] rpc_response_timeout = 120 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] run_external_periodic_tasks = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] scst_target_driver = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] scst_target_iqn_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_down_time = 720 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] shell_completion = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] snapshot_name_template = snapshot-%s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] split_loggers = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] state_path = /opt/stack/data/cinder {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] storage_availability_zone = nova {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] storage_protocol = iSCSI {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] syslog_log_facility = LOG_USER {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] target_helper = lioadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] target_ip_address = 192.168.122.211 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] target_port = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] target_protocol = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] target_secondary_ip_addresses = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] trace_flags = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] transport_url = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] until_refresh = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] use_chap_auth = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] use_default_quota_class = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] use_journal = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] use_json = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] use_multipath_for_image_xfer = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] use_stderr = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] use_syslog = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] verify_glance_signatures = enabled {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_api_class = cinder.volume.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_backend_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_clear = zero {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_clear_ionice = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_clear_size = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_copy_bps_limit = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_dd_blocksize = 1M {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_name_template = volume-%s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_service_inithost_offload = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volume_usage_audit_period = month {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] zoning_mode = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_concurrency.disable_process_locking = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.auth_section = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.auth_type = password {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.auth_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.cache = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.include_service_catalog = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.interface = public {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: INFO cinder.volume.manager [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.remotefs [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86108) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcache_username = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.region_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.service_type = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.backend = dogpile.cache.null {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.backend_argument = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.backend_expiration_time = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.config_prefix = cache.oslo {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.debug_cache_backend = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.enable_retry_client = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.enable_socket_keepalive = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.expiration_time = 600 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.hashclient_retry_attempts = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.memcache_dead_retry = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.memcache_pool_maxsize = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.memcache_sasl_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.proxies = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.redis_db = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.redis_server = localhost:6379 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.retry_attempts = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.retry_delay = 0.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.socket_keepalive_count = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.socket_keepalive_idle = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.socket_keepalive_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.socket_timeout = 1.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.tls_allowed_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.tls_cafile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.tls_certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.tls_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.tls_keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cache.username = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] coordination.backend_url = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.asyncio_connection = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.asyncio_slave_connection = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.backend = sqlalchemy {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.connection = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.connection_debug = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.connection_parameters = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.connection_recycle_time = 3600 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.connection_trace = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.db_inc_retry_interval = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.db_max_retries = 20 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.db_max_retry_interval = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.db_retry_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.max_overflow = 50 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.max_pool_size = 5 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.max_retries = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.mysql_wsrep_sync_wait = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.pool_timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.retry_interval = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.slave_connection = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.sqlite_synchronous = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.synchronous_reader = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] database.use_db_reconnect = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_tracing.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.connection_string = messaging:// {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.es_doc_type = notification {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.es_scroll_size = 10000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.es_scroll_time = 2m {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.filter_error_trace = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.hmac_keys = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.sentinel_service_name = mymaster {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.socket_timeout = 0.1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.trace_requests = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler.trace_sqlalchemy = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler_jaeger.process_tags = {} {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler_jaeger.service_name_prefix = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] profiler_otlp.service_name_prefix = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.enforce_new_defaults = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.policy_default_rule = default {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.policy_file = policy.yaml {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] privsep_osbrick.group = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] privsep_osbrick.helper_command = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] privsep_osbrick.user = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_sys_admin.group = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_sys_admin.helper_command = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] cinder_sys_admin.user = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.auth_section = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.auth_type = password {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.cafile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.collect_timing = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.send_service_user_token = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.split_loggers = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.tls_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] service_user.tls_min_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.auth_section = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.auth_type = password {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.collect_timing = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.region_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.split_loggers = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.tls_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] glance.tls_min_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.backend_availability_zone = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.chap_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.chap_username = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.disk_geometry = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.driver_client_cert = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.driver_client_cert_key = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.driver_data_namespace = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.driver_use_ssl = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.extra_capabilities = {} {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.filter_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.goodness_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.iscsi_target_flags = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.iscsi_write_cache = on {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.iser_helper = tgtadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.iser_port = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_host = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_login = admin {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_mount_options = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_private_key = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_share_path = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86108) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.num_shell_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: WARNING cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 11:53:30 devstack cinder-volume[86108]: WARNING cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.quobyte_volume_url = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.replication_device = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.report_discard_supported = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Running cmd (subprocess): mount.quobyte {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.reserved_percentage = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.target_helper = tgtadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.target_port = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.target_protocol = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.trace_flags = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.unique_fqdn_network = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.use_chap_auth = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_backend_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_clear = zero {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_clear_ionice = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_clear_size = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_reports.file_event_handler = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_reports.log_dir = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.backend_availability_zone = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.backend_host = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.chap_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.chap_username = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.chiscsi_conf = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.disk_geometry = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.driver_client_cert = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.driver_data_namespace = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.driver_use_ssl = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.extra_capabilities = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.filter_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.goodness_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.iser_helper = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.iser_ip_address = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.iser_port = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.iser_target_prefix = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_host = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_login = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_mount_options = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_private_key = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_share_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_ssh_port = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.num_shell_tries = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.nvmet_port_id = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.replication_device = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.report_discard_supported = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.reserved_percentage = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.scst_target_driver = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.storage_protocol = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.target_helper = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.target_ip_address = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.target_port = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.target_prefix = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.target_protocol = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.trace_flags = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.use_chap_auth = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_clear = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_clear_size = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] QuobyteHD.volumes_dir = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack quobyte-client[86111]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack quobyte-client[86111]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.ssl = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: INFO cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 ... Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_notifications.driver = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_notifications.retry = -1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f -c /etc/quobyte/client-cinder.cfg {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] key_manager.fixed_key = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.barbican_api_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.barbican_endpoint = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.barbican_endpoint_type = public {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.barbican_region_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.cafile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.collect_timing = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.number_of_retries = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.retry_delay = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.send_service_user_token = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.split_loggers = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.tls_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.tls_min_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.verify_ssl = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican.verify_ssl_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.auth_section = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.auth_type = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.cafile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.collect_timing = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.split_loggers = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.tls_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] barbican_service_user.tls_min_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.approle_role_id = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.approle_secret_id = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.auth_method = approle {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.auth_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.kv_mountpoint = secret {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.kv_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.kv_version = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.namespace = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.root_token_id = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.ssl_ca_crt_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.timeout = 60.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.token_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.token_role = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.use_ssl = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f -c /etc/quobyte/client-cinder.cfg Nov 05 11:53:30 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:30 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] ******************************************************************************** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 11:53:31 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.498s {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:31 devstack cinder-volume[86108]: INFO cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 succeeded Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.521s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:31 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:53:31 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:31 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.343s {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:31 devstack cinder-volume[86108]: INFO cinder.volume.driver [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG cinder.volume.driver [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4538040161133, 'free_capacity_gb': 1773.4538040161133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86108) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_db.sqlalchemy.engines [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86108) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG dbcounter [-] [86108] Writer thread running {{(pid=86108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG cinder.db.api [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Building query based on filter {{(pid=86108) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG cinder.image.image_utils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86108) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 11:53:31 devstack cinder-volume[86108]: INFO cinder.keymgr.migration [None req-b9edef97-01c5-4317-aa17-c24c4f0dc720 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:31 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:53:31 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:31 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.260s {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:31 devstack cinder-volume[86108]: DEBUG cinder.manager [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Notifying Schedulers of capabilities ... {{(pid=86108) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:53:32 devstack cinder-volume[86108]: INFO cinder.volume.manager [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Driver initialization completed successfully. Nov 05 11:53:32 devstack cinder-volume[86108]: INFO cinder.manager [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Initiating service 3 cleanup Nov 05 11:53:32 devstack cinder-volume[86108]: INFO cinder.manager [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Service 3 cleanup completed. Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG cinder.service [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Creating RPC server for service cinder-volume {{(pid=86108) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG cinder.service [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86108) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 11:53:32 devstack cinder-volume[86108]: INFO cinder.volume.manager [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:32 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:53:32 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:32 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:32 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.351s {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:32 devstack cinder-volume[86108]: INFO cinder.volume.manager [None req-16406640-f910-4c87-9af9-be6aafc1e663 None None] Driver post RPC initialization completed successfully. Nov 05 11:53:34 devstack cinder-volume[86108]: DEBUG oslo_service.periodic_task [None req-67a30309-0964-4ff6-afec-6c06ec5100e4 None None] Running periodic task VolumeManager._thread_info {{(pid=86108) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:53:34 devstack cinder-volume[86108]: DEBUG cinder.volume.manager [None req-67a30309-0964-4ff6-afec-6c06ec5100e4 None None] thread count: 6 {{(pid=86108) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:53:34 devstack cinder-volume[86108]: DEBUG cinder.volume.manager [None req-67a30309-0964-4ff6-afec-6c06ec5100e4 None None] thread info: [<_MainThread(MainThread, started 138025112318080)>, , , , , ] {{(pid=86108) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:53:37 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:53:37 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:53:37 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:53:37 devstack cinder-volume[86108]: DEBUG cinder.volume.drivers.quobyte [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:53:37 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:53:37 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:37 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:53:37 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:38 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:38 devstack cinder-volume[86108]: DEBUG oslo_concurrency.processutils [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.271s {{(pid=86108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:38 devstack cinder-volume[86108]: DEBUG cinder.manager [None req-e9653ffc-a955-4a8c-add2-b16ac24dc32a None None] Notifying Schedulers of capabilities ... {{(pid=86108) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:53:40 devstack cinder-volume[85887]: DEBUG dbcounter [-] [85887] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:53:40 devstack cinder-volume[85887]: INFO oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Caught SIGTERM, stopping children Nov 05 11:53:40 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Acquiring lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 11:53:40 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Acquired lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 11:53:40 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Releasing lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 11:53:40 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Stop services. {{(pid=85887) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 11:53:40 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Killing children. {{(pid=85887) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 11:53:40 devstack cinder-volume[85887]: INFO oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Waiting on 1 children to exit Nov 05 11:53:42 devstack cinder-volume[86108]: DEBUG dbcounter [-] [86108] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:53:42 devstack cinder-volume[86108]: DEBUG dbcounter [-] [86108] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:53:45 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Acquiring lock "singleton_lock" {{(pid=86108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 11:53:45 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Acquired lock "singleton_lock" {{(pid=86108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 11:53:45 devstack cinder-volume[86108]: DEBUG oslo_concurrency.lockutils [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Releasing lock "singleton_lock" {{(pid=86108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 11:53:45 devstack cinder-volume[86108]: WARNING amqp [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 11:53:45 devstack cinder-volume[86108]: WARNING amqp [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 11:53:45 devstack cinder-volume[85887]: INFO oslo_service.backend._eventlet.service [None req-9ed6627e-1d1a-43f7-97d1-2820973e1469 None None] Child 86108 exited with status 0 Nov 05 11:53:46 devstack cinder-volume[86652]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 11:53:46 devstack cinder-volume[86652]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 11:53:46 devstack cinder-volume[86652]: we strongly recommend against using it for new projects. Nov 05 11:53:46 devstack cinder-volume[86652]: If you are already using Eventlet, we recommend migrating to a different Nov 05 11:53:46 devstack cinder-volume[86652]: framework. For more detail see Nov 05 11:53:46 devstack cinder-volume[86652]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 11:53:46 devstack cinder-volume[86652]: import eventlet # noqa Nov 05 11:53:49 devstack cinder-volume[86652]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86652) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 11:53:49 devstack cinder-volume[86652]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86652) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 11:53:49 devstack cinder-volume[86652]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86652) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 11:53:50 devstack cinder-volume[86652]: INFO dbcounter [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Registered counter for database cinder Nov 05 11:53:50 devstack cinder-volume[86652]: DEBUG oslo_db.sqlalchemy.engines [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86652) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:50 devstack cinder-volume[86652]: DEBUG dbcounter [-] [86652] Writer thread running {{(pid=86652) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 11:53:50 devstack cinder-volume[86652]: INFO cinder.rpc [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 11:53:50 devstack cinder-volume[86652]: INFO cinder.rpc [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 11:53:50 devstack cinder-volume[86652]: DEBUG oslo_db.sqlalchemy.engines [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86652) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:50 devstack cinder-volume[86652]: INFO cinder.volume.manager [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Determined volume DB was empty at startup. Nov 05 11:53:50 devstack cinder-volume[86652]: DEBUG cinder.volume.manager [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86652) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 11:53:50 devstack cinder-volume[86652]: WARNING stevedore.named [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 11:53:50 devstack cinder-volume[86652]: WARNING castellan.key_manager [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 11:53:50 devstack cinder-volume[86652]: WARNING cinder.keymgr.conf_key_mgr [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 11:53:50 devstack cinder-volume[86652]: INFO cinder.volume.manager [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_db.sqlalchemy.engines [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86652) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:51 devstack cinder-volume[86652]: INFO oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Starting 1 workers Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Started child 86942 {{(pid=86652) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Full set of CONF: {{(pid=86652) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] ******************************************************************************** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] Configuration options gathered from: {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] ================================================================================ {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] allow_availability_zone_fallback = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] allow_compression_on_image_upload = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] allowed_direct_url_schemes = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] api_rate_limit = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] auth_strategy = keystone {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_availability_zone = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_host = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_stats_polling_interval = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backup_api_class = cinder.backup.api.API {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backup_name_template = backup-%s {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backup_use_same_host = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backup_use_temp_snapshot = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] chap_password = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] chap_username = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_internal_tenant_project_id = cc3c683a11e540bd9580b91b77ad8aee {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_internal_tenant_user_id = aebdf04522594e83b64b1d030bfb45bc {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cluster = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] compression_format = gzip {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] compute_api_class = cinder.compute.nova.API {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86942]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] config_dir = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] config_source = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] control_exchange = openstack {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] debug = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] default_availability_zone = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] default_group_type = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] default_volume_type = QuobyteHD {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] disk_geometry = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] driver_client_cert = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] driver_client_cert_key = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] driver_data_namespace = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] driver_ssl_cert_path = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] driver_ssl_cert_verify = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] driver_use_ssl = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] enable_new_services = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] enable_unsupported_driver = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] enabled_backends = ['QuobyteHD'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] enforce_multipath_for_image_xfer = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] filter_function = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_api_insecure = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_api_ssl_compression = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_ca_certificates_file = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_catalog_info = image:glance:publicURL {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_num_retries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance_request_timeout = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] goodness_function = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] graceful_shutdown_timeout = 5 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] group_api_class = cinder.group.api.API {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] host = devstack {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_compress_on_upload = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_conversion_address_space_limit = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_conversion_cpu_limit = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_conversion_disable = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_introspection_address_space_limit = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_introspection_cpu_limit = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_upload_use_cinder_backend = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_upload_use_internal_tenant = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_volume_cache_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_volume_cache_max_count = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] image_volume_cache_max_size_gb = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] init_host_max_objects_retrieval = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] instance_format = [instance: %(uuid)s] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] iscsi_target_flags = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] iscsi_write_cache = on {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] iser_helper = tgtadm {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] iser_ip_address = 192.168.122.211 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] iser_port = 3260 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_color = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_config_append = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_dir = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_file = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_options = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_rotate_interval = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_rotate_interval_type = days {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] log_rotation_type = none {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] max_age = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] max_logfile_count = 30 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] max_logfile_size_mb = 200 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] max_over_subscription_ratio = 20.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] message_reap_interval = 86400 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] message_ttl = 2592000 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] migration_create_volume_timeout_secs = 300 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] monkey_patch = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] monkey_patch_modules = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] my_ip = 192.168.122.211 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] no_snapshot_gb_quota = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] num_iser_scan_tries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] num_shell_tries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] num_volume_device_scan_tries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] nvmeof_conn_info_version = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] nvmet_ns_id = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] nvmet_port_id = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] osapi_max_limit = 1000 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] osapi_volume_ext_list = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] osapi_volume_listen_port = 8776 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] osapi_volume_use_ssl = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] osapi_volume_workers = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] per_volume_size_limit = -1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] periodic_fuzzy_delay = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] periodic_interval = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] public_endpoint = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] publish_errors = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] quota_backup_gigabytes = 1000 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] quota_backups = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] quota_gigabytes = 1000 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] quota_groups = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] quota_snapshots = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] quota_volumes = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] rate_limit_burst = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] rate_limit_except_level = CRITICAL {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] rate_limit_interval = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] reinit_driver_count = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] replication_device = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] report_discard_supported = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] report_interval = 120 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] reservation_clean_interval = 86400 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] reservation_expire = 86400 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] reserved_image_namespaces = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] reserved_percentage = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] rpc_response_timeout = 120 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] run_external_periodic_tasks = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] scst_target_driver = iscsi {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] scst_target_iqn_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_down_time = 720 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] shell_completion = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] snapshot_name_template = snapshot-%s {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] split_loggers = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] state_path = /opt/stack/data/cinder {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] storage_availability_zone = nova {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86942) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] storage_protocol = iSCSI {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] syslog_log_facility = LOG_USER {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] target_helper = lioadm {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] target_ip_address = 192.168.122.211 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] target_port = 3260 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] target_protocol = iscsi {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] target_secondary_ip_addresses = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] trace_flags = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] transport_url = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] until_refresh = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] use_chap_auth = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] use_default_quota_class = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] use_journal = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] use_json = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] use_multipath_for_image_xfer = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] use_stderr = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] use_syslog = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] verify_glance_signatures = enabled {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_api_class = cinder.volume.api.API {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_backend_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_clear = zero {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_clear_ionice = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_clear_size = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_copy_bps_limit = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_dd_blocksize = 1M {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_name_template = volume-%s {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_service_inithost_offload = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volume_usage_audit_period = month {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] zoning_mode = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_concurrency.disable_process_locking = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.auth_section = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.auth_type = password {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.auth_version = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.cache = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.include_service_catalog = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.insecure = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.interface = public {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_password = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcache_username = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.region_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.service_type = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.backend = dogpile.cache.null {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.backend_argument = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.backend_expiration_time = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.config_prefix = cache.oslo {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.debug_cache_backend = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.enable_retry_client = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.enable_socket_keepalive = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.expiration_time = 600 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.hashclient_retry_attempts = 2 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.memcache_dead_retry = 300 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.memcache_pool_maxsize = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.memcache_sasl_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.password = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.proxies = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.redis_db = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.redis_server = localhost:6379 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.retry_attempts = 2 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.retry_delay = 0.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.socket_keepalive_count = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.socket_keepalive_idle = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.socket_keepalive_interval = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.socket_timeout = 1.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.tls_allowed_ciphers = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.tls_cafile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.tls_certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.tls_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.tls_keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cache.username = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] coordination.backend_url = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.asyncio_connection = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.asyncio_slave_connection = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.backend = sqlalchemy {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.connection = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.connection_debug = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.connection_parameters = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.connection_recycle_time = 3600 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.connection_trace = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.db_inc_retry_interval = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.db_max_retries = 20 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.db_max_retry_interval = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.db_retry_interval = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.max_overflow = 50 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.max_pool_size = 5 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.max_retries = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.mysql_wsrep_sync_wait = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.pool_timeout = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.retry_interval = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.slave_connection = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.sqlite_synchronous = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.synchronous_reader = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] database.use_db_reconnect = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_tracing.insecure = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.connection_string = messaging:// {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.es_doc_type = notification {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.es_scroll_size = 10000 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.es_scroll_time = 2m {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.filter_error_trace = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.hmac_keys = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.sentinel_service_name = mymaster {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.socket_timeout = 0.1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86942) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.trace_requests = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler.trace_sqlalchemy = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler_jaeger.process_tags = {} {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler_jaeger.service_name_prefix = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] profiler_otlp.service_name_prefix = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.enforce_new_defaults = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.policy_default_rule = default {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.policy_file = policy.yaml {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Running cmd (subprocess): mount.quobyte {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] privsep_osbrick.group = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] privsep_osbrick.helper_command = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] privsep_osbrick.user = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_sys_admin.group = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_sys_admin.helper_command = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] cinder_sys_admin.user = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.auth_section = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.auth_type = password {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.cafile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.collect_timing = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.insecure = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.send_service_user_token = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.split_loggers = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.timeout = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.tls_ciphers = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] service_user.tls_min_version = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.auth_section = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.auth_type = password {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.collect_timing = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.insecure = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.region_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.split_loggers = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.timeout = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.tls_ciphers = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] glance.tls_min_version = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.backend_availability_zone = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.chap_password = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.chap_username = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.disk_geometry = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.driver_client_cert = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.driver_client_cert_key = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.driver_data_namespace = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.driver_use_ssl = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.extra_capabilities = {} {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.filter_function = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.goodness_function = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.iscsi_target_flags = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.iscsi_write_cache = on {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.iser_helper = tgtadm {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.iser_port = 3260 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_host = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_login = admin {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_mount_options = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_password = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_private_key = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_share_path = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.num_shell_tries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.quobyte_volume_url = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.replication_device = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.report_discard_supported = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.reserved_percentage = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.target_helper = tgtadm {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.target_port = 3260 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.target_protocol = iscsi {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.trace_flags = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.unique_fqdn_network = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.use_chap_auth = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_backend_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_clear = zero {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_clear_ionice = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_clear_size = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_reports.file_event_handler = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_reports.log_dir = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.backend_availability_zone = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.backend_host = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.chap_password = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.chap_username = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.chiscsi_conf = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.disk_geometry = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.driver_client_cert = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.driver_data_namespace = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.driver_use_ssl = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.extra_capabilities = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.filter_function = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.goodness_function = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.iser_helper = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.iser_ip_address = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.iser_port = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.iser_target_prefix = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_host = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_login = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_mount_options = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_password = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_private_key = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_share_path = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_ssh_port = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.num_shell_tries = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.nvmet_port_id = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack quobyte-client[86943]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.replication_device = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.report_discard_supported = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.reserved_percentage = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack quobyte-client[86943]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.scst_target_driver = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.storage_protocol = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.target_helper = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.target_ip_address = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.target_port = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.target_prefix = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.target_protocol = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.trace_flags = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.use_chap_auth = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_clear = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_clear_size = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] QuobyteHD.volumes_dir = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.ssl = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_notifications.driver = [] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_notifications.retry = -1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] key_manager.fixed_key = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.barbican_api_version = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.barbican_endpoint = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.barbican_endpoint_type = public {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.barbican_region_name = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.cafile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.collect_timing = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.insecure = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.number_of_retries = 60 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.retry_delay = 1 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.send_service_user_token = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.split_loggers = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.timeout = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.tls_ciphers = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.tls_min_version = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.verify_ssl = True {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican.verify_ssl_path = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.auth_section = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.auth_type = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.cafile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.certfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.collect_timing = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.insecure = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.keyfile = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.split_loggers = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.timeout = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.tls_ciphers = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] barbican_service_user.tls_min_version = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.approle_role_id = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.approle_secret_id = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.auth_method = approle {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.auth_path = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.kv_mountpoint = secret {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.kv_path = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.kv_version = 2 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.namespace = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.root_token_id = **** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.ssl_ca_crt_file = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.timeout = 60.0 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.token_file = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.token_role = None {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.use_ssl = False {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 11:53:51 devstack cinder-volume[86652]: DEBUG oslo_service.backend._eventlet.service [None req-940ad7a6-d389-4ecf-9364-e324e61aa250 None None] ******************************************************************************** {{(pid=86652) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 11:53:51 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:53:51 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:51 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.262s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:51 devstack cinder-volume[86942]: INFO cinder.volume.driver [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.volume.driver [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3944854736328, 'free_capacity_gb': 1773.3944854736328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86942) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_db.sqlalchemy.engines [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writer thread running {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.db.api [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Building query based on filter {{(pid=86942) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86942) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:51 devstack cinder-volume[86942]: INFO cinder.keymgr.migration [None req-b096002b-6a5d-4948-b78a-b378df1965a8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 11:53:51 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:53:51 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:51 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.269s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:53:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Driver initialization completed successfully. Nov 05 11:53:52 devstack cinder-volume[86942]: INFO cinder.manager [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Initiating service 3 cleanup Nov 05 11:53:52 devstack cinder-volume[86942]: INFO cinder.manager [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Service 3 cleanup completed. Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG cinder.service [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Creating RPC server for service cinder-volume {{(pid=86942) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG cinder.service [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86942) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 11:53:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:53:52 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:53:52 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:53:52 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.302s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:53:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d6fb0b4b-7e6f-4744-91d9-729d18fae799 None None] Driver post RPC initialization completed successfully. Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 6 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:53:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:54:01 devstack cinder-volume[86652]: DEBUG dbcounter [-] [86652] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86652) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:54:02 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:54:02 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:54:52 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:54:52 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:54:52 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.472s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 6 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:54:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Flow 'volume_create_manager' (893bfcb8-9a43-4d08-8267-59ce824340e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd47c139-915f-4a86-bdb7-ca49f866abe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd47c139-915f-4a86-bdb7-ca49f866abe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-764587879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be9c954-a0d9-4b43-a766-78506a4cc2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908f7bf41b684184825f6d4edc2f4dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:29Z,use_quota=True,user_id='f4fb477417b34a338243bbbcfd569562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e699df0c-a16f-47a5-bf69-c54175436a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e699df0c-a16f-47a5-bf69-c54175436a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcf3a77-de03-4c53-a6c4-4f163ceaba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcf3a77-de03-4c53-a6c4-4f163ceaba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be9c954-a0d9-4b43-a766-78506a4cc2f5', 'volume_name': 'volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4c2d6b-ac31-4bf9-b45d-9d73426a9e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4c2d6b-ac31-4bf9-b45d-9d73426a9e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0169609e-efe9-4a1e-a3ef-2d846d178172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Volume 7be9c954-a0d9-4b43-a766-78506a4cc2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5', 'volume_size': 1} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-764587879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be9c954-a0d9-4b43-a766-78506a4cc2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908f7bf41b684184825f6d4edc2f4dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:29Z,use_quota=True,user_id='f4fb477417b34a338243bbbcfd569562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Creating volume 7be9c954-a0d9-4b43-a766-78506a4cc2f5 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:55:29 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:55:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:29 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 1073741824 Nov 05 11:55:29 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:31 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 1073741824" returned: 0 in 1.549s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:31 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 Nov 05 11:55:31 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:31 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5" returned: 0 in 0.485s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:55:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0169609e-efe9-4a1e-a3ef-2d846d178172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67948c9f-2279-47d4-89f0-a9ca78fb4bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:32 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Volume volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 (7be9c954-a0d9-4b43-a766-78506a4cc2f5): created successfully Nov 05 11:55:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67948c9f-2279-47d4-89f0-a9ca78fb4bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Flow 'volume_create_manager' (893bfcb8-9a43-4d08-8267-59ce824340e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:55:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c62c2491-2f34-4755-8164-5bfa4362ed20 tempest-VolumesAdminNegativeTest-1325096225 None] Created volume successfully. Nov 05 11:55:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Acquiring lock "cinder-7be9c954-a0d9-4b43-a766-78506a4cc2f5-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:55:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "cinder-7be9c954-a0d9-4b43-a766-78506a4cc2f5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:55:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Acquiring lock "cinder-quobyte-7be9c954-a0d9-4b43-a766-78506a4cc2f5" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:55:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "cinder-quobyte-7be9c954-a0d9-4b43-a766-78506a4cc2f5" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:55:34 devstack cinder-volume[86942]: INFO oslo.privsep.daemon [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpive_a5pn/privsep.sock'] Nov 05 11:55:34 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpive_a5pn/privsep.sock Nov 05 11:55:34 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 11:55:35 devstack cinder-volume[86942]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 11:55:36 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:36 devstack cinder-volume[86942]: INFO oslo.privsep.daemon [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Spawned new privsep daemon via rootwrap Nov 05 11:55:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Accepted privsep connection to /tmp/tmpive_a5pn/privsep.sock {{(pid=86942) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 11:55:36 devstack cinder-volume[86942]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 11:55:36 devstack cinder-volume[86942]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 11:55:36 devstack cinder-volume[86942]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 11:55:36 devstack cinder-volume[86942]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88330 Nov 05 11:55:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e005fa3-14d7-4174-9fbf-7637c70477ed]: (2,) {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:55:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735d065-c3a2-4d7a-8c7a-bb77728d6da8]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:55:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:36 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 Nov 05 11:55:36 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:36 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5" returned: 0 in 0.476s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:36 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5 Nov 05 11:55:36 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:36 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7be9c954-a0d9-4b43-a766-78506a4cc2f5" returned: 0 in 0.334s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "cinder-quobyte-7be9c954-a0d9-4b43-a766-78506a4cc2f5" released by "delete_volume" :: held 2.818s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:55:37 devstack cinder-volume[86942]: WARNING cinder.quota [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:55:37 devstack cinder-volume[86942]: WARNING cinder.quota [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Created reservations ['d696ecc6-c56f-476a-b5b7-e4f20689fe43', 'a53ba7df-0c1c-450e-9eee-4d3a131dcb85', '4aef01fc-3ad1-4ede-85c0-712293855bcb', '06b02b24-9b4c-41f9-a1ee-d962aad972e0'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:37 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:55:37 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:37 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.311s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:55:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Deleted volume successfully. Nov 05 11:55:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8479e890-061e-4b33-ba7c-ce2e4a300672 tempest-VolumesAdminNegativeTest-1325096225 None] Lock "cinder-7be9c954-a0d9-4b43-a766-78506a4cc2f5-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Flow 'volume_create_manager' (21dd9f72-eecc-4107-ab77-fd59185dcb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a7f302-6cb8-476e-82b8-0b6df8c4de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a7f302-6cb8-476e-82b8-0b6df8c4de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-535590873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e6c286-1071-4373-a032-21974fed3dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8e2494bf7f492aae12a5959626f4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:47Z,use_quota=True,user_id='83a677192dbe46ab80c59b90b0508a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fec380-3b99-4427-bb34-a9784bfd1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fec380-3b99-4427-bb34-a9784bfd1767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0c1cf2-34e4-43a0-9959-c790e132b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0c1cf2-34e4-43a0-9959-c790e132b0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e6c286-1071-4373-a032-21974fed3dae', 'volume_name': 'volume-f1e6c286-1071-4373-a032-21974fed3dae', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b427a0a-899f-4eb9-9bbf-d767d326e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b427a0a-899f-4eb9-9bbf-d767d326e816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8572ac52-930b-4e7b-87f7-b2628c2dadc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Volume f1e6c286-1071-4373-a032-21974fed3dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e6c286-1071-4373-a032-21974fed3dae', 'volume_size': 1} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-535590873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e6c286-1071-4373-a032-21974fed3dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8e2494bf7f492aae12a5959626f4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:47Z,use_quota=True,user_id='83a677192dbe46ab80c59b90b0508a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Creating volume f1e6c286-1071-4373-a032-21974fed3dae {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:55:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:55:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:55:47 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:55:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:47 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae 1073741824 Nov 05 11:55:47 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:47 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae 1073741824" returned: 0 in 0.644s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:47 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae Nov 05 11:55:47 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:48 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae" returned: 0 in 0.388s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:55:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8572ac52-930b-4e7b-87f7-b2628c2dadc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e6c286-1071-4373-a032-21974fed3dae', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0542384-9db5-4e45-8d09-6745cc4237f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Volume volume-f1e6c286-1071-4373-a032-21974fed3dae (f1e6c286-1071-4373-a032-21974fed3dae): created successfully Nov 05 11:55:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0542384-9db5-4e45-8d09-6745cc4237f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Flow 'volume_create_manager' (21dd9f72-eecc-4107-ab77-fd59185dcb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:55:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-651a0187-5019-4941-b223-92735be8bba9 tempest-AttachVolumeShelveTestJSON-91686469 None] Created volume successfully. Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Flow 'volume_create_manager' (2b3564c6-79ea-4a74-87c4-3d2c8693f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966cddd5-355d-409f-a0fa-c473956f2d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966cddd5-355d-409f-a0fa-c473956f2d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2104023669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97eb660e-4b64-4e82-bb9a-693fd708528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f235cf6cf2498d9df9e3696c13a928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:49Z,use_quota=True,user_id='ea98d7dd338e45308a56c9b47caeab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c217ea91-d9e0-4b2d-9096-cd17857ef48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c217ea91-d9e0-4b2d-9096-cd17857ef48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc26306a-9ebb-4fb4-84d5-0e0abd004faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc26306a-9ebb-4fb4-84d5-0e0abd004faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97eb660e-4b64-4e82-bb9a-693fd708528f', 'volume_name': 'volume-97eb660e-4b64-4e82-bb9a-693fd708528f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb14fe44-0136-42dd-ab8b-cfef1bae116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb14fe44-0136-42dd-ab8b-cfef1bae116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614e0d97-fe3c-4055-b7ce-76fdc96c6cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:49 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Volume 97eb660e-4b64-4e82-bb9a-693fd708528f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97eb660e-4b64-4e82-bb9a-693fd708528f', 'volume_size': 1} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2104023669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97eb660e-4b64-4e82-bb9a-693fd708528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f235cf6cf2498d9df9e3696c13a928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:49Z,use_quota=True,user_id='ea98d7dd338e45308a56c9b47caeab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Creating volume 97eb660e-4b64-4e82-bb9a-693fd708528f {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:55:49 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:55:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:49 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f 1073741824 Nov 05 11:55:49 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:50 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f 1073741824" returned: 0 in 0.759s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:50 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f Nov 05 11:55:50 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:50 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614e0d97-fe3c-4055-b7ce-76fdc96c6cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97eb660e-4b64-4e82-bb9a-693fd708528f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07979706-b52a-45e6-8617-7188e8e38ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:55:50 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Volume volume-97eb660e-4b64-4e82-bb9a-693fd708528f (97eb660e-4b64-4e82-bb9a-693fd708528f): created successfully Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07979706-b52a-45e6-8617-7188e8e38ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:55:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Flow 'volume_create_manager' (2b3564c6-79ea-4a74-87c4-3d2c8693f338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:55:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-086be630-1935-4462-b9a3-7e2c03d71cf5 tempest-AttachVolumeNegativeTest-1795982735 None] Created volume successfully. Nov 05 11:55:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:55:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:55:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:55:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:55:52 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:55:52 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:55:53 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Nov 05 11:55:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.583s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:55:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:55:56 devstack cinder-volume[86942]: WARNING py.warnings [req-af764e8d-6bcd-49c5-b6df-7919fc229610 req-be297f09-d696-4eb8-8220-21de6f8d4772 tempest-AttachVolumeNegativeTest-1795982735 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 05 11:55:56 devstack cinder-volume[86942]: .first() Nov 05 11:55:56 devstack cinder-volume[86942]: Nov 05 11:55:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-af764e8d-6bcd-49c5-b6df-7919fc229610 req-be297f09-d696-4eb8-8220-21de6f8d4772 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:55:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-af764e8d-6bcd-49c5-b6df-7919fc229610 req-be297f09-d696-4eb8-8220-21de6f8d4772 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:55:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-af764e8d-6bcd-49c5-b6df-7919fc229610 req-be297f09-d696-4eb8-8220-21de6f8d4772 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:55:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-af764e8d-6bcd-49c5-b6df-7919fc229610 req-be297f09-d696-4eb8-8220-21de6f8d4772 tempest-AttachVolumeNegativeTest-1795982735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-97eb660e-4b64-4e82-bb9a-693fd708528f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '797248bd-0aee-46bb-a3f4-de787e4d0e22', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:55:56 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-af764e8d-6bcd-49c5-b6df-7919fc229610 req-be297f09-d696-4eb8-8220-21de6f8d4772 tempest-AttachVolumeNegativeTest-1795982735 None] attachment_update completed successfully. Nov 05 11:56:06 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:56:06 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:56:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-9c17d0a4-ba5c-4370-b0b7-bd4cff6bebdf req-e8aa1c83-1199-4b8f-8251-a4920b83dd1c tempest-AttachVolumeShelveTestJSON-91686469 None] No connector for attachment dd5919e8-e029-43eb-94d5-5c3a6552db6d; skipping storage backend terminate_connection call. {{(pid=86942) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 05 11:56:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-9c17d0a4-ba5c-4370-b0b7-bd4cff6bebdf req-e8aa1c83-1199-4b8f-8251-a4920b83dd1c tempest-AttachVolumeShelveTestJSON-91686469 None] Deleting attachment dd5919e8-e029-43eb-94d5-5c3a6552db6d. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Flow 'volume_create_manager' (6a9029ea-ba48-464b-9831-6782d5f70e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a06bba3-04bc-4f7e-b0e1-37967c9ffc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a06bba3-04bc-4f7e-b0e1-37967c9ffc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-248364924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a51d52b-28c3-411f-bd42-fc364b7896bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e95d28bda4f0ca76841f7d9506308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:23Z,use_quota=True,user_id='37e0aea8cc084284a8166a8a1a266352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577a5418-0162-40b4-987a-d28fe11ea3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577a5418-0162-40b4-987a-d28fe11ea3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c161d964-3b4f-43a6-9ef7-6cde8c248233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c161d964-3b4f-43a6-9ef7-6cde8c248233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a51d52b-28c3-411f-bd42-fc364b7896bc', 'volume_name': 'volume-2a51d52b-28c3-411f-bd42-fc364b7896bc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b8b4fd-d64b-4388-9c75-27cd781ba36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b8b4fd-d64b-4388-9c75-27cd781ba36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34585dd6-7b75-4bdc-9032-479c1c1045c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:22 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Volume 2a51d52b-28c3-411f-bd42-fc364b7896bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a51d52b-28c3-411f-bd42-fc364b7896bc', 'volume_size': 1} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-248364924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a51d52b-28c3-411f-bd42-fc364b7896bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e95d28bda4f0ca76841f7d9506308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:23Z,use_quota=True,user_id='37e0aea8cc084284a8166a8a1a266352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Creating volume 2a51d52b-28c3-411f-bd42-fc364b7896bc {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:56:22 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:56:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:56:22 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc 1073741824 Nov 05 11:56:22 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:56:23 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc 1073741824" returned: 0 in 0.658s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:56:23 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc Nov 05 11:56:23 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:56:23 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34585dd6-7b75-4bdc-9032-479c1c1045c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a51d52b-28c3-411f-bd42-fc364b7896bc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1189763c-b231-4200-9430-e4b98c50741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:23 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Volume volume-2a51d52b-28c3-411f-bd42-fc364b7896bc (2a51d52b-28c3-411f-bd42-fc364b7896bc): created successfully Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1189763c-b231-4200-9430-e4b98c50741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Flow 'volume_create_manager' (6a9029ea-ba48-464b-9831-6782d5f70e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:56:23 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-17522902-c044-4300-bf27-f1a3f0196d5e tempest-TaggedAttachmentsTest-996194870 None] Created volume successfully. Nov 05 11:56:33 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=5 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:56:33 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:56:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:56:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:56:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:56:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:56:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:56:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:56:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:56:52 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:56:52 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:56:53 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Nov 05 11:56:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.860s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:56:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:56:53 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:56:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 8 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:56:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Flow 'volume_create_manager' (397f5974-8831-437b-a7d6-bb898af2ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5053dc-10f5-4a35-905b-f701081ff97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5053dc-10f5-4a35-905b-f701081ff97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2011014090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75c5a74-c8cd-4c64-85a2-bc891ad8f612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6437fe3e6204b549490a3829843bd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:57Z,use_quota=True,user_id='73662f35a3bc450b90c2727e16ca1ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477ca8d2-0ca3-4b1a-9f98-fd431ddb8fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477ca8d2-0ca3-4b1a-9f98-fd431ddb8fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb62162-d9ae-4bf6-8319-38bc29d93945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb62162-d9ae-4bf6-8319-38bc29d93945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75c5a74-c8cd-4c64-85a2-bc891ad8f612', 'volume_name': 'volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4966a756-8670-4842-b808-e0a0b496cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4966a756-8670-4842-b808-e0a0b496cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5197ac0c-aef7-4f8e-b962-0232348346f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:57 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Volume b75c5a74-c8cd-4c64-85a2-bc891ad8f612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612', 'volume_size': 1} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2011014090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75c5a74-c8cd-4c64-85a2-bc891ad8f612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6437fe3e6204b549490a3829843bd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:57Z,use_quota=True,user_id='73662f35a3bc450b90c2727e16ca1ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Creating volume b75c5a74-c8cd-4c64-85a2-bc891ad8f612 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:56:57 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:56:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:56:57 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 1073741824 Nov 05 11:56:57 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:56:58 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Nov 05 11:56:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 1073741824" returned: 0 in 1.531s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:56:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:56:59 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 Nov 05 11:56:59 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:56:59 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Nov 05 11:56:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612" returned: 0 in 0.909s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:56:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] <== create_volume: return (2604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:56:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.607s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:56:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5197ac0c-aef7-4f8e-b962-0232348346f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38adc521-0b52-425d-be25-88dfa80fb9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:56:59 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Volume volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 (b75c5a74-c8cd-4c64-85a2-bc891ad8f612): created successfully Nov 05 11:56:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38adc521-0b52-425d-be25-88dfa80fb9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:56:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Flow 'volume_create_manager' (397f5974-8831-437b-a7d6-bb898af2ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:57:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-49b5dc7f-0579-4b11-8a0b-28016429c6e0 tempest-DeleteServersTestJSON-356625194 None] Created volume successfully. Nov 05 11:57:01 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-6488e474-9d4f-4249-9f46-2b8b44064f59 req-d5b88ce4-5b3c-4a89-b2c2-43ae184948ee tempest-AttachVolumeNegativeTest-1795982735 None] Terminate volume connection completed successfully. Nov 05 11:57:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-6488e474-9d4f-4249-9f46-2b8b44064f59 req-d5b88ce4-5b3c-4a89-b2c2-43ae184948ee tempest-AttachVolumeNegativeTest-1795982735 None] Deleting attachment 797248bd-0aee-46bb-a3f4-de787e4d0e22. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:57:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-1f1f086b-9890-461d-af51-ab943ab01539 req-03debcf2-8b5d-43ff-be20-314857a333f5 tempest-DeleteServersTestJSON-356625194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-1f1f086b-9890-461d-af51-ab943ab01539 req-03debcf2-8b5d-43ff-be20-314857a333f5 tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-1f1f086b-9890-461d-af51-ab943ab01539 req-03debcf2-8b5d-43ff-be20-314857a333f5 tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.110s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-1f1f086b-9890-461d-af51-ab943ab01539 req-03debcf2-8b5d-43ff-be20-314857a333f5 tempest-DeleteServersTestJSON-356625194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ebb2f23-0e57-42f8-be27-473b17c92885', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:57:03 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-1f1f086b-9890-461d-af51-ab943ab01539 req-03debcf2-8b5d-43ff-be20-314857a333f5 tempest-DeleteServersTestJSON-356625194 None] attachment_update completed successfully. Nov 05 11:57:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-f67186f7-8428-47c8-bd37-923aaf39cbed req-e24d5145-146c-4193-b68b-fc82cb0eb431 tempest-DeleteServersTestJSON-356625194 None] Terminate volume connection completed successfully. Nov 05 11:57:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-f67186f7-8428-47c8-bd37-923aaf39cbed req-e24d5145-146c-4193-b68b-fc82cb0eb431 tempest-DeleteServersTestJSON-356625194 None] Deleting attachment 5ebb2f23-0e57-42f8-be27-473b17c92885. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:57:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Acquiring lock "cinder-b75c5a74-c8cd-4c64-85a2-bc891ad8f612-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Lock "cinder-b75c5a74-c8cd-4c64-85a2-bc891ad8f612-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Acquiring lock "cinder-quobyte-b75c5a74-c8cd-4c64-85a2-bc891ad8f612" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Lock "cinder-quobyte-b75c5a74-c8cd-4c64-85a2-bc891ad8f612" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:10 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da50569-23b8-46cf-b564-9b421ab777a2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:57:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:10 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 Nov 05 11:57:10 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:11 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:11 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612 Nov 05 11:57:11 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:11 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75c5a74-c8cd-4c64-85a2-bc891ad8f612" returned: 0 in 0.281s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Lock "cinder-quobyte-b75c5a74-c8cd-4c64-85a2-bc891ad8f612" released by "delete_volume" :: held 0.783s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Created reservations ['c0eccc2c-3114-4fe4-85b0-5155a6d6203c', '66d3924f-5e7a-4590-945b-72dcbfb5a030', '71335042-9b12-4dee-b90d-aea750a258c6', '2aceee7e-8828-4d85-90b3-6fb499c5a4f2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:11 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:57:11 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:11 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.318s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:57:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Deleted volume successfully. Nov 05 11:57:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7f0d8fe-cbf9-48a8-8338-398670fd822b tempest-DeleteServersTestJSON-356625194 None] Lock "cinder-b75c5a74-c8cd-4c64-85a2-bc891ad8f612-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:57:21 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:57:21 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:57:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c0b2687a-352c-47a6-abe7-571d7f12ea5f req-3c6ddac9-d5ca-4ea6-8739-5a04af862cf3 tempest-TaggedAttachmentsTest-996194870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c0b2687a-352c-47a6-abe7-571d7f12ea5f req-3c6ddac9-d5ca-4ea6-8739-5a04af862cf3 tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c0b2687a-352c-47a6-abe7-571d7f12ea5f req-3c6ddac9-d5ca-4ea6-8739-5a04af862cf3 tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c0b2687a-352c-47a6-abe7-571d7f12ea5f req-3c6ddac9-d5ca-4ea6-8739-5a04af862cf3 tempest-TaggedAttachmentsTest-996194870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-2a51d52b-28c3-411f-bd42-fc364b7896bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a85611c-9b83-460e-b49c-928cdf264515', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:57:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-c0b2687a-352c-47a6-abe7-571d7f12ea5f req-3c6ddac9-d5ca-4ea6-8739-5a04af862cf3 tempest-TaggedAttachmentsTest-996194870 None] attachment_update completed successfully. Nov 05 11:57:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Acquiring lock "cinder-f1e6c286-1071-4373-a032-21974fed3dae-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "cinder-f1e6c286-1071-4373-a032-21974fed3dae-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Acquiring lock "cinder-quobyte-f1e6c286-1071-4373-a032-21974fed3dae" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "cinder-quobyte-f1e6c286-1071-4373-a032-21974fed3dae" acquired by "delete_volume" :: waited 0.065s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac38028c-e88c-4e9d-898e-47e9574f405b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:57:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:33 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae Nov 05 11:57:33 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:33 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae" returned: 0 in 0.788s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:34 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae Nov 05 11:57:34 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:34 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f1e6c286-1071-4373-a032-21974fed3dae" returned: 0 in 0.570s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "cinder-quobyte-f1e6c286-1071-4373-a032-21974fed3dae" released by "delete_volume" :: held 1.500s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Created reservations ['c37655f5-2102-4a2a-905f-42be269a9d61', 'ebab2b92-27f5-4e62-ba64-bc9f37758906', '76d9a113-defc-45bb-b831-a05023a1c5d0', '8c19b2aa-8a0a-458a-9e8d-61ee8d17e9f3'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:34 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:57:34 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:35 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.325s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:35 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:57:35 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Deleted volume successfully. Nov 05 11:57:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8f6729be-2844-430f-9547-a94d0be3d998 tempest-AttachVolumeShelveTestJSON-91686469 None] Lock "cinder-f1e6c286-1071-4373-a032-21974fed3dae-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:57:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-fde72693-69d6-4ba4-89d3-22a3a54a1197 req-364f337d-ce61-40a0-bd48-8e42fa35a9d6 tempest-TaggedAttachmentsTest-996194870 None] Terminate volume connection completed successfully. Nov 05 11:57:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-fde72693-69d6-4ba4-89d3-22a3a54a1197 req-364f337d-ce61-40a0-bd48-8e42fa35a9d6 tempest-TaggedAttachmentsTest-996194870 None] Deleting attachment 1a85611c-9b83-460e-b49c-928cdf264515. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:57:44 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Flow 'volume_create_manager' (58bf8dce-de43-4ea2-af28-0b676c3d82f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed824705-c0e9-4cbc-b741-d2c34cecc36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed824705-c0e9-4cbc-b741-d2c34cecc36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-428372446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5ece6a-1a89-41a1-9e23-acab471a0a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f235cf6cf2498d9df9e3696c13a928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:47Z,use_quota=True,user_id='ea98d7dd338e45308a56c9b47caeab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5a6b0a-dbbe-43f4-906f-8fbf2b0ba5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5a6b0a-dbbe-43f4-906f-8fbf2b0ba5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c015fd-4733-42a4-abf0-c07c43dfa40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c015fd-4733-42a4-abf0-c07c43dfa40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5ece6a-1a89-41a1-9e23-acab471a0a28', 'volume_name': 'volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8a3a9b-47f2-4483-8487-748aa923e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8a3a9b-47f2-4483-8487-748aa923e508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859fad8a-b3a0-481c-9fec-0e2f98af83a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Volume 3b5ece6a-1a89-41a1-9e23-acab471a0a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28', 'volume_size': 1} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-428372446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5ece6a-1a89-41a1-9e23-acab471a0a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f235cf6cf2498d9df9e3696c13a928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:47Z,use_quota=True,user_id='ea98d7dd338e45308a56c9b47caeab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Creating volume 3b5ece6a-1a89-41a1-9e23-acab471a0a28 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:57:47 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:57:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:47 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 1073741824 Nov 05 11:57:47 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:48 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 1073741824" returned: 0 in 0.919s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:48 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 Nov 05 11:57:48 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:48 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:57:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859fad8a-b3a0-481c-9fec-0e2f98af83a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff87e9d-c89d-44ed-9be0-7fbcee42a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:49 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Volume volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 (3b5ece6a-1a89-41a1-9e23-acab471a0a28): created successfully Nov 05 11:57:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff87e9d-c89d-44ed-9be0-7fbcee42a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Flow 'volume_create_manager' (58bf8dce-de43-4ea2-af28-0b676c3d82f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:57:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-edd60e17-7d1c-4fcc-8c35-36593e9c0ecd tempest-AttachVolumeNegativeTest-1795982735 None] Created volume successfully. Nov 05 11:57:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-199069ba-2550-4d57-9c37-c250dc6d4f2a req-803a4746-7f6e-4c70-a0fd-55287fc573e8 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-199069ba-2550-4d57-9c37-c250dc6d4f2a req-803a4746-7f6e-4c70-a0fd-55287fc573e8 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-199069ba-2550-4d57-9c37-c250dc6d4f2a req-803a4746-7f6e-4c70-a0fd-55287fc573e8 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-199069ba-2550-4d57-9c37-c250dc6d4f2a req-803a4746-7f6e-4c70-a0fd-55287fc573e8 tempest-AttachVolumeNegativeTest-1795982735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04e88c5d-9ff5-43c1-abc5-099dc0407f7a', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:57:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-199069ba-2550-4d57-9c37-c250dc6d4f2a req-803a4746-7f6e-4c70-a0fd-55287fc573e8 tempest-AttachVolumeNegativeTest-1795982735 None] attachment_update completed successfully. Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:52 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:57:52 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:52 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.417s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 8 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:57:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:57:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-635d0bd7-056d-4cea-82da-ef1851d559cb req-5b7390e6-ac18-488a-9807-0b11aede5bcb tempest-AttachVolumeNegativeTest-1795982735 None] Terminate volume connection completed successfully. Nov 05 11:57:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-635d0bd7-056d-4cea-82da-ef1851d559cb req-5b7390e6-ac18-488a-9807-0b11aede5bcb tempest-AttachVolumeNegativeTest-1795982735 None] Deleting attachment 04e88c5d-9ff5-43c1-abc5-099dc0407f7a. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:57:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Acquiring lock "cinder-2a51d52b-28c3-411f-bd42-fc364b7896bc-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Lock "cinder-2a51d52b-28c3-411f-bd42-fc364b7896bc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Acquiring lock "cinder-quobyte-2a51d52b-28c3-411f-bd42-fc364b7896bc" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Lock "cinder-quobyte-2a51d52b-28c3-411f-bd42-fc364b7896bc" acquired by "delete_volume" :: waited 0.051s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[03532335-44f7-4b33-aab2-d4880097cdd2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:57:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Flow 'volume_create_manager' (d35d771a-a2e7-4d5a-9ed8-8101f242970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286c617d-d2b1-49b8-8fc1-ab461a1c6bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:56 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc Nov 05 11:57:56 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286c617d-d2b1-49b8-8fc1-ab461a1c6bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1215569476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11afa756-b795-4ada-842a-a10dad3314d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a764c84f4b247f0b25cd7a1d812b887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:56Z,use_quota=True,user_id='85c1108ba9ea4d7780ea853785812f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd6da3e-3147-462f-8d3c-8a9bc42a9f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd6da3e-3147-462f-8d3c-8a9bc42a9f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d15f718-9779-4830-8ca4-f670384112f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d15f718-9779-4830-8ca4-f670384112f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11afa756-b795-4ada-842a-a10dad3314d9', 'volume_name': 'volume-11afa756-b795-4ada-842a-a10dad3314d9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727b9bd6-ccc5-4aa8-92fa-9e01caf8063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727b9bd6-ccc5-4aa8-92fa-9e01caf8063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2409c231-7a79-4457-bc61-e3518236e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:56 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Volume 11afa756-b795-4ada-842a-a10dad3314d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11afa756-b795-4ada-842a-a10dad3314d9', 'volume_size': 1} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1215569476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11afa756-b795-4ada-842a-a10dad3314d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a764c84f4b247f0b25cd7a1d812b887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:56Z,use_quota=True,user_id='85c1108ba9ea4d7780ea853785812f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Creating volume 11afa756-b795-4ada-842a-a10dad3314d9 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:57:56 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:56 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 1073741824 Nov 05 11:57:56 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:56 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc" returned: 0 in 0.713s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:56 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc Nov 05 11:57:56 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:57 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 1073741824" returned: 0 in 0.782s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:57 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 Nov 05 11:57:57 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:57 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a51d52b-28c3-411f-bd42-fc364b7896bc" returned: 0 in 0.623s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Lock "cinder-quobyte-2a51d52b-28c3-411f-bd42-fc364b7896bc" released by "delete_volume" :: held 1.453s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Created reservations ['b963bebb-89f7-46e4-aeb1-3094fddc75e1', 'dab8ce2b-66ac-4164-82f1-df7e0cbab803', '72e8c6ef-4629-4f6b-b504-33356209d83c', '0f5d3d6c-b2e2-4bbc-abf5-067ffc194869'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:57 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:57 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:57:57 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9" returned: 0 in 0.714s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:57:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2409c231-7a79-4457-bc61-e3518236e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11afa756-b795-4ada-842a-a10dad3314d9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f204a427-54c0-421e-bcdc-c25be8e5709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:57:58 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Volume volume-11afa756-b795-4ada-842a-a10dad3314d9 (11afa756-b795-4ada-842a-a10dad3314d9): created successfully Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f204a427-54c0-421e-bcdc-c25be8e5709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Flow 'volume_create_manager' (d35d771a-a2e7-4d5a-9ed8-8101f242970f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:57:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-ec5ab2b8-3d23-4298-8764-3a41f17f986c req-9b8a21be-c927-4f03-b950-de357f7c4d78 tempest-VolumesGetTestJSON-2129291777 None] Created volume successfully. Nov 05 11:57:58 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.591s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:57:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Deleted volume successfully. Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0316dc9e-150e-4f3c-ab4f-026f141a5890 tempest-TaggedAttachmentsTest-996194870 None] Lock "cinder-2a51d52b-28c3-411f-bd42-fc364b7896bc-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Acquiring lock "cinder-11afa756-b795-4ada-842a-a10dad3314d9-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Lock "cinder-11afa756-b795-4ada-842a-a10dad3314d9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Acquiring lock "cinder-quobyte-11afa756-b795-4ada-842a-a10dad3314d9" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:57:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Lock "cinder-quobyte-11afa756-b795-4ada-842a-a10dad3314d9" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:57:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6280115e-bd3d-4bb8-8064-a4e713513aa0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:57:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:59 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 Nov 05 11:57:59 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:57:59 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Nov 05 11:57:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9" returned: 0 in 0.571s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:57:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:57:59 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9 Nov 05 11:57:59 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:00 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-11afa756-b795-4ada-842a-a10dad3314d9" returned: 0 in 0.338s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Lock "cinder-quobyte-11afa756-b795-4ada-842a-a10dad3314d9" released by "delete_volume" :: held 1.002s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG cinder.quota [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Created reservations ['432e7d59-8065-4ef6-9b77-956b615920ab', 'ca6fce93-a8e2-49b0-a2ad-7962535d6221', 'cf6e83e0-0606-4e2f-9734-03cb72f53b26', 'fdec426d-7d22-434a-9e6a-bee3b4d11d3a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:00 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:58:00 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:00 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.420s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG cinder.manager [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:58:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Deleted volume successfully. Nov 05 11:58:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-7c693c96-bafd-4c8e-be27-37c1f65f217d req-5d1ef8a3-6308-49ac-9cf0-9740157073af tempest-VolumesGetTestJSON-2129291777 None] Lock "cinder-11afa756-b795-4ada-842a-a10dad3314d9-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:58:10 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=32,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:58:10 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:58:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6ac4d9d6-8f5d-4aa9-be4b-fe6a39376f43 tempest-GroupSnapshotsV319Test-1734561144 None] Group tempest-GroupSnapshotsV319Test-Group-1137783124: creating Nov 05 11:58:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6ac4d9d6-8f5d-4aa9-be4b-fe6a39376f43 tempest-GroupSnapshotsV319Test-1734561144 None] Group tempest-GroupSnapshotsV319Test-Group-1137783124: created successfully Nov 05 11:58:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6ac4d9d6-8f5d-4aa9-be4b-fe6a39376f43 tempest-GroupSnapshotsV319Test-1734561144 None] Create group completed successfully. Nov 05 11:58:12 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Flow 'volume_create_manager' (c2b7d873-3138-435b-a038-1899e07e538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2857082-9c15-46a5-a44a-377fe7bd4a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2857082-9c15-46a5-a44a-377fe7bd4a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326380181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa5a8f3a-7d1d-4336-ab4f-30141c7d7e21,host='devstack@QuobyteHD#QuobyteHD',id=56a2afa8-6942-44ef-bcf3-508211bf378d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f228fdda63674558bfed6d619fea3852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:13Z,use_quota=True,user_id='7f014475dd0e4dbcbadbd08c090490fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e3cc0e-b5fa-4bfa-859d-9607fd72c90c),volume_type_id=05e3cc0e-b5fa-4bfa-859d-9607fd72c90c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d579cefb-172c-47d7-b0aa-1d0ccc132610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d579cefb-172c-47d7-b0aa-1d0ccc132610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088ee682-da71-4e41-b946-472a38e30306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088ee682-da71-4e41-b946-472a38e30306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a2afa8-6942-44ef-bcf3-508211bf378d', 'volume_name': 'volume-56a2afa8-6942-44ef-bcf3-508211bf378d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e063fa-0d22-442a-8e72-a6cf7c7c9697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e063fa-0d22-442a-8e72-a6cf7c7c9697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bc3c13-6447-4961-adfd-7ae7ef6a5132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Volume 56a2afa8-6942-44ef-bcf3-508211bf378d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a2afa8-6942-44ef-bcf3-508211bf378d', 'volume_size': 1} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa5a8f3a-7d1d-4336-ab4f-30141c7d7e21,created_at=2026-11-05T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326380181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa5a8f3a-7d1d-4336-ab4f-30141c7d7e21,host='devstack@QuobyteHD#QuobyteHD',id=56a2afa8-6942-44ef-bcf3-508211bf378d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f228fdda63674558bfed6d619fea3852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:13Z,use_quota=True,user_id='7f014475dd0e4dbcbadbd08c090490fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e3cc0e-b5fa-4bfa-859d-9607fd72c90c),volume_type_id=05e3cc0e-b5fa-4bfa-859d-9607fd72c90c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Creating volume 56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:58:13 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:13 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d 1073741824 Nov 05 11:58:13 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:13 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d 1073741824" returned: 0 in 0.796s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:14 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d Nov 05 11:58:14 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:14 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d" returned: 0 in 0.356s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:58:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bc3c13-6447-4961-adfd-7ae7ef6a5132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a2afa8-6942-44ef-bcf3-508211bf378d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11471bc9-44b4-408d-a873-b2b606dd77fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:14 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Volume volume-56a2afa8-6942-44ef-bcf3-508211bf378d (56a2afa8-6942-44ef-bcf3-508211bf378d): created successfully Nov 05 11:58:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11471bc9-44b4-408d-a873-b2b606dd77fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Flow 'volume_create_manager' (c2b7d873-3138-435b-a038-1899e07e538f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-05f2a333-69e7-4357-a27f-52c232863dfc tempest-GroupSnapshotsV319Test-1734561144 None] Created volume successfully. Nov 05 11:58:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] GroupSnapshot b73e752d-f889-4cb2-9068-aa285f19b08e: creating. Nov 05 11:58:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Group snapshot b73e752d-f889-4cb2-9068-aa285f19b08e: creating. {{(pid=86942) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 11:58:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Creating offline snapshot b652fbc7-ddd7-4806-b547-1cc6fbd30f3e of volume 56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:58:16 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2d63e7-22a6-429b-ab90-99788b1dd26c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:58:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:16 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d Nov 05 11:58:16 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:17 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d" returned: 0 in 0.857s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:17 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e 1G Nov 05 11:58:17 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:18 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e 1G" returned: 0 in 0.885s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a2afa8-6942-44ef-bcf3-508211bf378d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:18 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a2afa8-6942-44ef-bcf3-508211bf378d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e Nov 05 11:58:18 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:18 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a2afa8-6942-44ef-bcf3-508211bf378d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" returned: 0 in 0.603s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:18 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:58:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:18 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e Nov 05 11:58:18 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Flow 'volume_create_manager' (38c14e15-3031-478e-9ca4-133b0a7daee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcded6ae-bd3b-4d45-9170-4d796a8a10cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcded6ae-bd3b-4d45-9170-4d796a8a10cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-369230360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8f197d-6713-49d3-bbbd-40d94c75c0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e27597cf574351964143cc7d1b27c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:19Z,use_quota=True,user_id='65b34b1bb1134870a37542e1972c5c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c0d6ed-bfd9-4b41-9cca-304172e7df35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c0d6ed-bfd9-4b41-9cca-304172e7df35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bf93a4-0d34-4bb3-9fca-51e3a6f3740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12bf93a4-0d34-4bb3-9fca-51e3a6f3740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8f197d-6713-49d3-bbbd-40d94c75c0ac', 'volume_name': 'volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a0c9b0-a079-4763-9ea0-e04538545719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:19 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a0c9b0-a079-4763-9ea0-e04538545719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489543d6-3915-402a-b412-11c13549296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:19 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Volume 2a8f197d-6713-49d3-bbbd-40d94c75c0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac', 'volume_size': 1} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" returned: 0 in 0.711s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:19 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.info Nov 05 11:58:19 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:19 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.info" returned: 0 in 0.433s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:19 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:58:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:19 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.info Nov 05 11:58:19 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:20 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.info" returned: 0 in 0.490s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.163s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-369230360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8f197d-6713-49d3-bbbd-40d94c75c0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e27597cf574351964143cc7d1b27c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:19Z,use_quota=True,user_id='65b34b1bb1134870a37542e1972c5c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Creating volume 2a8f197d-6713-49d3-bbbd-40d94c75c0ac {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:58:20 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:58:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:20 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac 1073741824 Nov 05 11:58:20 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5d775b1f-fe0f-4246-a95c-5f943b9c93c0 tempest-GroupSnapshotsV319Test-1734561144 None] group_snapshot b73e752d-f889-4cb2-9068-aa285f19b08e: created successfully Nov 05 11:58:21 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac 1073741824" returned: 0 in 0.921s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:21 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac Nov 05 11:58:21 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:21 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489543d6-3915-402a-b412-11c13549296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21317c1d-5425-460b-b9a1-720361a65558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Volume volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac (2a8f197d-6713-49d3-bbbd-40d94c75c0ac): created successfully Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21317c1d-5425-460b-b9a1-720361a65558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Flow 'volume_create_manager' (38c14e15-3031-478e-9ca4-133b0a7daee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:21 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fa84fcd8-adcc-4dab-bc7b-c49997ac1768 tempest-ServerActionsTestOtherA-1114459445 None] Created volume successfully. Nov 05 11:58:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] group_snapshot b73e752d-f889-4cb2-9068-aa285f19b08e: deleting Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] group_snapshot b73e752d-f889-4cb2-9068-aa285f19b08e: deleting {{(pid=86942) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Acquiring lock "cinder-quobyte-56a2afa8-6942-44ef-bcf3-508211bf378d" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "cinder-quobyte-56a2afa8-6942-44ef-bcf3-508211bf378d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Acquiring lock "cinder-quobyte-b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "cinder-quobyte-b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Deleting offline snapshot b652fbc7-ddd7-4806-b547-1cc6fbd30f3e of volume 56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] snapshot_file for this snap is: volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[be909131-4b48-4c17-a334-7ef8060a0c12]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:58:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:22 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e Nov 05 11:58:22 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:23 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" returned: 0 in 0.502s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56a2afa8-6942-44ef-bcf3-508211bf378d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:58:23 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[103e5468-d0b4-49ca-8143-1c0f5905fdf7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:58:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:23 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d Nov 05 11:58:23 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:23 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d" returned: 0 in 0.684s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:23 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e Nov 05 11:58:23 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:24 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" returned: 0 in 0.556s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:24 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e Nov 05 11:58:24 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:24 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d.b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" returned: 0 in 0.343s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "cinder-quobyte-b652fbc7-ddd7-4806-b547-1cc6fbd30f3e" released by "_delete_snapshot" :: held 2.256s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:58:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "cinder-quobyte-56a2afa8-6942-44ef-bcf3-508211bf378d" released by "delete_snapshot" :: held 2.301s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:58:25 devstack cinder-volume[86942]: WARNING cinder.quota [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1509402191 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1509402191, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:58:25 devstack cinder-volume[86942]: WARNING cinder.quota [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1509402191 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1509402191, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:58:25 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] Created reservations ['301eaf1f-7bfd-49cf-8b62-e8a31fe168d0', '5adc8dbc-262e-4fe1-a843-dabb00502861', '38c8a9f7-9853-4eb1-9cf1-fc4e5506b59c', 'cc45ac7f-f58c-4e5c-8d54-ed30412a2665'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:58:25 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-70b25cbe-4747-4803-b114-30d93922f2c9 tempest-GroupSnapshotsV319Test-1734561144 None] group_snapshot b73e752d-f889-4cb2-9068-aa285f19b08e: deleted successfully Nov 05 11:58:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Acquiring lock "cinder-quobyte-56a2afa8-6942-44ef-bcf3-508211bf378d" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:58:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "cinder-quobyte-56a2afa8-6942-44ef-bcf3-508211bf378d" acquired by "delete_volume" :: waited 0.037s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:58:25 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854e72b-10a1-4b8e-8937-1d8e0c3841ae]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:58:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:26 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d Nov 05 11:58:26 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:26 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d" returned: 0 in 0.575s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:26 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d Nov 05 11:58:26 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:26 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-56a2afa8-6942-44ef-bcf3-508211bf378d" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "cinder-quobyte-56a2afa8-6942-44ef-bcf3-508211bf378d" released by "delete_volume" :: held 1.218s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Created reservations ['b9c58bde-c8c8-42a7-9332-0426c98821fa'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:58:27 devstack cinder-volume[86942]: WARNING cinder.quota [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1509402191 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1509402191, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Created reservations ['3360912b-8efc-445f-92eb-2c374c5e11ab', '56201879-50c0-4854-94de-9634be3e8076', '8f415b58-981c-4c5b-adbc-556352b6a3f7', '7fd524ab-075b-4569-ac43-60ab6a24e789'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:27 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:58:27 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:28 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.624s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:28 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:58:28 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9a73d9e7-0b65-4761-be1f-0342461f7961 tempest-GroupSnapshotsV319Test-1734561144 None] Delete group completed successfully. Nov 05 11:58:37 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=21 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:58:37 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:58:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b3336301-db6d-4ac7-ace9-12293b943868 tempest-GroupsV314Test-426216329 None] Group tempest-GroupsV314Test-Group-1038100599: creating Nov 05 11:58:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b3336301-db6d-4ac7-ace9-12293b943868 tempest-GroupsV314Test-426216329 None] Group tempest-GroupsV314Test-Group-1038100599: created successfully Nov 05 11:58:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b3336301-db6d-4ac7-ace9-12293b943868 tempest-GroupsV314Test-426216329 None] Create group completed successfully. Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Flow 'volume_create_manager' (7a41cdb5-5a38-4517-89ee-75c75bc79f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb460d0d-b367-40e7-9d7d-4769c2c62e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb460d0d-b367-40e7-9d7d-4769c2c62e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324386005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f5ed8ce-9f1f-40a3-9b01-ad95a6e50855,host='devstack@QuobyteHD#QuobyteHD',id=e962e8ab-fb57-4100-b42d-99339749b6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae3b365e2e4360b92b86e2d77f8bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:44Z,use_quota=True,user_id='468f01e56ff94d6b903a870ba3168bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dce8c9e-9dd6-475a-8fe8-415914185bd1),volume_type_id=4dce8c9e-9dd6-475a-8fe8-415914185bd1)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01d01cb-963a-4d34-9b6b-93bf8b872bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01d01cb-963a-4d34-9b6b-93bf8b872bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835989ec-2167-4a29-b691-79da3b1ceb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835989ec-2167-4a29-b691-79da3b1ceb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e962e8ab-fb57-4100-b42d-99339749b6f5', 'volume_name': 'volume-e962e8ab-fb57-4100-b42d-99339749b6f5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24829d2-f07a-47bb-934e-851f14eeda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24829d2-f07a-47bb-934e-851f14eeda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0279aba9-6296-4877-9391-c61264030fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:44 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Volume e962e8ab-fb57-4100-b42d-99339749b6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e962e8ab-fb57-4100-b42d-99339749b6f5', 'volume_size': 1} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f5ed8ce-9f1f-40a3-9b01-ad95a6e50855,created_at=2026-11-05T10:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324386005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f5ed8ce-9f1f-40a3-9b01-ad95a6e50855,host='devstack@QuobyteHD#QuobyteHD',id=e962e8ab-fb57-4100-b42d-99339749b6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae3b365e2e4360b92b86e2d77f8bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:44Z,use_quota=True,user_id='468f01e56ff94d6b903a870ba3168bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dce8c9e-9dd6-475a-8fe8-415914185bd1),volume_type_id=4dce8c9e-9dd6-475a-8fe8-415914185bd1)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Creating volume e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:58:44 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:58:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:44 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 1073741824 Nov 05 11:58:44 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Flow 'volume_create_manager' (4494abdc-4df7-453e-987c-42020cafc01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff334083-165b-44b9-8e87-debc3709d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:45 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 1073741824" returned: 0 in 1.026s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff334083-165b-44b9-8e87-debc3709d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-214334963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd84b9a-c386-41a6-bb6b-62880a35d0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f235cf6cf2498d9df9e3696c13a928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:46Z,use_quota=True,user_id='ea98d7dd338e45308a56c9b47caeab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79c239d-9184-41d3-94cd-c7692fc2ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79c239d-9184-41d3-94cd-c7692fc2ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048651f7-2fec-458b-8f69-a2ec0362d606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048651f7-2fec-458b-8f69-a2ec0362d606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd84b9a-c386-41a6-bb6b-62880a35d0a2', 'volume_name': 'volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d4efe8-1c41-46fd-9c71-7b64560033cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d4efe8-1c41-46fd-9c71-7b64560033cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc86a8a5-09af-4749-89f3-5759980f68e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:45 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Volume 2bd84b9a-c386-41a6-bb6b-62880a35d0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2', 'volume_size': 1} Nov 05 11:58:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:46 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 Nov 05 11:58:46 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:46 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5" returned: 0 in 0.381s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-214334963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd84b9a-c386-41a6-bb6b-62880a35d0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f235cf6cf2498d9df9e3696c13a928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:46Z,use_quota=True,user_id='ea98d7dd338e45308a56c9b47caeab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Creating volume 2bd84b9a-c386-41a6-bb6b-62880a35d0a2 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:58:46 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0279aba9-6296-4877-9391-c61264030fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e962e8ab-fb57-4100-b42d-99339749b6f5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528ff660-f71c-4c2e-8f53-1b90e6250cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:46 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 1073741824 Nov 05 11:58:46 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Volume volume-e962e8ab-fb57-4100-b42d-99339749b6f5 (e962e8ab-fb57-4100-b42d-99339749b6f5): created successfully Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528ff660-f71c-4c2e-8f53-1b90e6250cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Flow 'volume_create_manager' (7a41cdb5-5a38-4517-89ee-75c75bc79f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2d14d1b4-3fb4-46ca-b354-cf70d72252d5 tempest-GroupsV314Test-426216329 None] Created volume successfully. Nov 05 11:58:47 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 1073741824" returned: 0 in 0.805s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:47 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 Nov 05 11:58:47 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:47 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2" returned: 0 in 0.530s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:58:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc86a8a5-09af-4749-89f3-5759980f68e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c8a779-8640-40c6-b0e2-d15bce794f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:58:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Volume volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 (2bd84b9a-c386-41a6-bb6b-62880a35d0a2): created successfully Nov 05 11:58:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c8a779-8640-40c6-b0e2-d15bce794f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:58:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Flow 'volume_create_manager' (4494abdc-4df7-453e-987c-42020cafc01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:58:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d0fca404-e665-4279-90cc-6247824c98e0 tempest-AttachVolumeNegativeTest-1795982735 None] Created volume successfully. Nov 05 11:58:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:49 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Cloning volume e962e8ab-fb57-4100-b42d-99339749b6f5 to volume 089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 Nov 05 11:58:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Creating offline snapshot 5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 of volume e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:58:49 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9fa755-4648-4a6e-a932-84e5ccad8f4c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:58:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:49 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 Nov 05 11:58:49 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:50 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5" returned: 0 in 1.055s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:50 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 1G Nov 05 11:58:50 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-f5de0dd9-f1c6-4682-8052-da3a12417ef2 req-0a7e212f-4196-4b3d-b1a6-e346aba2d6e2 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:51 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 1G" returned: 0 in 0.843s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e962e8ab-fb57-4100-b42d-99339749b6f5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:51 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e962e8ab-fb57-4100-b42d-99339749b6f5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 Nov 05 11:58:51 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:51 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e962e8ab-fb57-4100-b42d-99339749b6f5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" returned: 0 in 0.419s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:51 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:58:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:51 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 Nov 05 11:58:51 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:52 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" returned: 0 in 0.487s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:52 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.info Nov 05 11:58:52 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:52 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:58:52 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:53 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.info" returned: 0 in 0.721s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:53 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:53 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.info Nov 05 11:58:53 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:53 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.742s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 8 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:58:53 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.info" returned: 0 in 0.625s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Acquiring lock "cinder-quobyte-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] snapshot: 5c70c3d9-d7fe-4d7b-a54b-b2263d18e758, volume: 089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b6995-a389-423a-865a-c90e844c6715]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:58:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:54 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 Nov 05 11:58:54 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:54 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" returned: 0 in 0.807s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e962e8ab-fb57-4100-b42d-99339749b6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:58:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4380828-e43d-42c7-83fc-3276c1d08555]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:58:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:54 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 Nov 05 11:58:54 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:58:55 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Nov 05 11:58:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5" returned: 0 in 0.521s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:58:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:58:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:58:55 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:58:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:58:55 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 Nov 05 11:58:55 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:02 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:59:02 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:59:07 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" returned: 0 in 12.802s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:07 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5, size 1024.00 MB, duration 12.80 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:59:07 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Converted 1024.00 MB image at 79.98 MB/s Nov 05 11:59:07 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:59:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:08 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 Nov 05 11:59:08 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b90271e6-270e-485a-8b38-cb9993dbd2ad req-29ed445d-6913-4f8b-ba70-782b0ce8e1e2 tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:08 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" returned: 0 in 0.420s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" released by "_copy_volume_from_snapshot" :: held 14.707s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Acquiring lock "cinder-quobyte-5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Deleting offline snapshot 5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 of volume e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] snapshot_file for this snap is: volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4216a969-9098-4739-9595-874a8d616139]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:08 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 Nov 05 11:59:08 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:08 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" returned: 0 in 0.437s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e962e8ab-fb57-4100-b42d-99339749b6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:59:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35083e5-8d89-42da-a598-6dd44ff13f67]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:09 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 Nov 05 11:59:09 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:09 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5" returned: 0 in 0.837s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:09 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 Nov 05 11:59:09 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:10 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" returned: 0 in 0.509s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:10 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758 Nov 05 11:59:10 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:10 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5.5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" returned: 0 in 0.274s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-5c70c3d9-d7fe-4d7b-a54b-b2263d18e758" released by "_delete_snapshot" :: held 2.251s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.491s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-f5de0dd9-f1c6-4682-8052-da3a12417ef2 req-0a7e212f-4196-4b3d-b1a6-e346aba2d6e2 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.970s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-f5de0dd9-f1c6-4682-8052-da3a12417ef2 req-0a7e212f-4196-4b3d-b1a6-e346aba2d6e2 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b90271e6-270e-485a-8b38-cb9993dbd2ad req-29ed445d-6913-4f8b-ba70-782b0ce8e1e2 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.525s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b90271e6-270e-485a-8b38-cb9993dbd2ad req-29ed445d-6913-4f8b-ba70-782b0ce8e1e2 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.165s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-f5de0dd9-f1c6-4682-8052-da3a12417ef2 req-0a7e212f-4196-4b3d-b1a6-e346aba2d6e2 tempest-AttachVolumeNegativeTest-1795982735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cc57b11-4220-40da-b614-d4981ff81422', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:59:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-b90271e6-270e-485a-8b38-cb9993dbd2ad req-29ed445d-6913-4f8b-ba70-782b0ce8e1e2 tempest-ServerActionsTestOtherA-1114459445 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22c96fad-72b9-4ab8-b79a-e3bafd48f71f', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:59:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-67149b0f-9e9e-4196-b450-4a7493f344bb tempest-GroupsV314Test-426216329 None] Create group from source-group-4f5ed8ce-9f1f-40a3-9b01-ad95a6e50855 completed successfully. Nov 05 11:59:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-f5de0dd9-f1c6-4682-8052-da3a12417ef2 req-0a7e212f-4196-4b3d-b1a6-e346aba2d6e2 tempest-AttachVolumeNegativeTest-1795982735 None] attachment_update completed successfully. Nov 05 11:59:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-b90271e6-270e-485a-8b38-cb9993dbd2ad req-29ed445d-6913-4f8b-ba70-782b0ce8e1e2 tempest-ServerActionsTestOtherA-1114459445 None] attachment_update completed successfully. Nov 05 11:59:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Acquiring lock "cinder-quobyte-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" acquired by "delete_volume" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:12 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028869e-f0b2-461a-8065-036f6766d93e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:12 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 Nov 05 11:59:12 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:13 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" returned: 0 in 0.756s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:13 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5 Nov 05 11:59:13 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:13 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" returned: 0 in 0.432s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-089b5bd4-345c-4ba5-ad4b-4695fe4a6fa5" released by "delete_volume" :: held 1.339s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:13 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Created reservations ['0cdb24db-55da-4cd9-9964-3467b02fd5be'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:14 devstack cinder-volume[86942]: WARNING cinder.quota [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1740671189 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1740671189, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:59:14 devstack cinder-volume[86942]: WARNING cinder.quota [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1740671189 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1740671189, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Created reservations ['90c6cd75-4fa7-4374-9e52-b14a852441fe', '49dfdbf9-7590-4305-9c73-d4f37b2e754d', '66d0d914-c89d-4a7e-b5ce-d05c09b55da1', 'a6ec4ef9-d844-4182-b0ec-8e2b7a59eed5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:14 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:14 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-4587ea81-e7d7-4eb6-ab04-1743db809b52 req-9e469bbe-0b0c-42af-a99f-00b7ed5ccbda tempest-AttachVolumeNegativeTest-1795982735 None] Terminate volume connection completed successfully. Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-4587ea81-e7d7-4eb6-ab04-1743db809b52 req-9e469bbe-0b0c-42af-a99f-00b7ed5ccbda tempest-AttachVolumeNegativeTest-1795982735 None] Deleting attachment 8cc57b11-4220-40da-b614-d4981ff81422. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:59:14 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.407s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:14 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9f5fe2ba-2e45-4430-a448-571cea982e94 tempest-GroupsV314Test-426216329 None] Delete group completed successfully. Nov 05 11:59:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Acquiring lock "cinder-quobyte-e962e8ab-fb57-4100-b42d-99339749b6f5" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-e962e8ab-fb57-4100-b42d-99339749b6f5" acquired by "delete_volume" :: waited 0.051s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[024ff952-dce7-4c0a-b0f5-5ab6798d8592]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:16 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 Nov 05 11:59:16 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:16 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5" returned: 0 in 0.893s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:16 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5 Nov 05 11:59:16 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:17 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e962e8ab-fb57-4100-b42d-99339749b6f5" returned: 0 in 0.682s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Lock "cinder-quobyte-e962e8ab-fb57-4100-b42d-99339749b6f5" released by "delete_volume" :: held 1.778s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:17 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Created reservations ['c40951d4-804f-4aa6-91eb-c3d54331aaa3'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:17 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Created reservations ['5fd0299e-15ba-4519-a42a-22bc114e23d8', '72899d5d-9e17-456d-8e92-ed1b86403a4c', 'ed0a6ec1-bf51-430b-b8dd-ed971e9baa3f', '67296628-de66-4d90-9b42-bee298641d42'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:18 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:18 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:18 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-6e7293ba-9ced-495c-ad7d-689fd0e9f80a req-5b24caf6-0c18-47ff-9fc9-68d6ef8d53db tempest-ServerActionsTestOtherA-1114459445 None] Terminate volume connection completed successfully. Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-6e7293ba-9ced-495c-ad7d-689fd0e9f80a req-5b24caf6-0c18-47ff-9fc9-68d6ef8d53db tempest-ServerActionsTestOtherA-1114459445 None] Deleting attachment 22c96fad-72b9-4ab8-b79a-e3bafd48f71f. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:59:18 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.661s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:18 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-40cf67bb-53f8-4996-b9a9-cdc73aec8826 tempest-GroupsV314Test-426216329 None] Delete group completed successfully. Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Flow 'volume_create_manager' (ec8d1412-63a2-4094-b00a-6ad032c39bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3b9aab-7a4b-4bc9-8807-60a5f561a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3b9aab-7a4b-4bc9-8807-60a5f561a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1595585523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c550f420-4804-4828-ba13-8e9a9014d930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e37ed3aed464da8783cb0f94bd423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:19Z,use_quota=True,user_id='6692111e57c64d289d1ec95bd6b0a920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aa01f6-56cf-4a56-a550-6bb748104d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aa01f6-56cf-4a56-a550-6bb748104d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df21449-8420-4aa0-aee7-c882acf8169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df21449-8420-4aa0-aee7-c882acf8169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c550f420-4804-4828-ba13-8e9a9014d930', 'volume_name': 'volume-c550f420-4804-4828-ba13-8e9a9014d930', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace71f2a-45f3-4744-a7be-10c81647ae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace71f2a-45f3-4744-a7be-10c81647ae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87df9af9-6a05-4311-87b4-746cb181ecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:18 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Volume c550f420-4804-4828-ba13-8e9a9014d930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c550f420-4804-4828-ba13-8e9a9014d930', 'volume_size': 1} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1595585523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c550f420-4804-4828-ba13-8e9a9014d930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e37ed3aed464da8783cb0f94bd423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:19Z,use_quota=True,user_id='6692111e57c64d289d1ec95bd6b0a920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Creating volume c550f420-4804-4828-ba13-8e9a9014d930 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:18 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:19 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 1073741824 Nov 05 11:59:19 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-6e7293ba-9ced-495c-ad7d-689fd0e9f80a req-a7ff633f-4b3f-438a-ad45-aa89ec47c8f6 tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:19 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 1073741824" returned: 0 in 0.843s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:19 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 Nov 05 11:59:19 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:20 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930" returned: 0 in 0.372s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-6e7293ba-9ced-495c-ad7d-689fd0e9f80a req-a7ff633f-4b3f-438a-ad45-aa89ec47c8f6 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.703s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87df9af9-6a05-4311-87b4-746cb181ecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c550f420-4804-4828-ba13-8e9a9014d930', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a3bdf1-380c-4ecb-b98a-75e6f82c287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-6e7293ba-9ced-495c-ad7d-689fd0e9f80a req-a7ff633f-4b3f-438a-ad45-aa89ec47c8f6 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:20 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Volume volume-c550f420-4804-4828-ba13-8e9a9014d930 (c550f420-4804-4828-ba13-8e9a9014d930): created successfully Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a3bdf1-380c-4ecb-b98a-75e6f82c287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Flow 'volume_create_manager' (ec8d1412-63a2-4094-b00a-6ad032c39bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9c19990e-7296-44a7-8678-be196d7f1daf tempest-ServersNegativeTestJSON-1310889834 None] Created volume successfully. Nov 05 11:59:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-6e7293ba-9ced-495c-ad7d-689fd0e9f80a req-a7ff633f-4b3f-438a-ad45-aa89ec47c8f6 tempest-ServerActionsTestOtherA-1114459445 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfb99ab8-c743-425d-aec5-e12149b2d4d2', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:59:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-6e7293ba-9ced-495c-ad7d-689fd0e9f80a req-a7ff633f-4b3f-438a-ad45-aa89ec47c8f6 tempest-ServerActionsTestOtherA-1114459445 None] attachment_update completed successfully. Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Flow 'volume_create_manager' (e96d38b6-43d0-4243-8581-adeada7d073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ec9e72-4e4e-48a0-99d1-dc1d34cc2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ec9e72-4e4e-48a0-99d1-dc1d34cc2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1549282527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ca83ff-de6d-4379-bcb4-d17af638d1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e37ed3aed464da8783cb0f94bd423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:24Z,use_quota=True,user_id='6692111e57c64d289d1ec95bd6b0a920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc461fe-3b93-4fff-a78b-fa770afdeb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc461fe-3b93-4fff-a78b-fa770afdeb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c3dcdb-fca4-4e41-b8be-b4cd8a01b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c3dcdb-fca4-4e41-b8be-b4cd8a01b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ca83ff-de6d-4379-bcb4-d17af638d1a0', 'volume_name': 'volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f30d54-ca02-4a82-a8e7-fed3c71817fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f30d54-ca02-4a82-a8e7-fed3c71817fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e90211-0f89-4f61-b021-fb20ef6e5ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:24 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Volume 28ca83ff-de6d-4379-bcb4-d17af638d1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0', 'volume_size': 1} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1549282527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ca83ff-de6d-4379-bcb4-d17af638d1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e37ed3aed464da8783cb0f94bd423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:24Z,use_quota=True,user_id='6692111e57c64d289d1ec95bd6b0a920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Creating volume 28ca83ff-de6d-4379-bcb4-d17af638d1a0 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:24 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:24 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 1073741824 Nov 05 11:59:24 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "cinder-2bd84b9a-c386-41a6-bb6b-62880a35d0a2-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-2bd84b9a-c386-41a6-bb6b-62880a35d0a2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "cinder-quobyte-2bd84b9a-c386-41a6-bb6b-62880a35d0a2" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-quobyte-2bd84b9a-c386-41a6-bb6b-62880a35d0a2" acquired by "delete_volume" :: waited 0.051s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b5bafc-89d1-4591-a7e9-40db1724a18f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:25 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 1073741824" returned: 0 in 0.889s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:25 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 Nov 05 11:59:25 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:25 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 Nov 05 11:59:25 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:25 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0" returned: 0 in 0.475s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e90211-0f89-4f61-b021-fb20ef6e5ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e76734f-bf06-454e-b564-276deddb47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:25 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2" returned: 0 in 0.795s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:25 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Volume volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 (28ca83ff-de6d-4379-bcb4-d17af638d1a0): created successfully Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e76734f-bf06-454e-b564-276deddb47e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Flow 'volume_create_manager' (e96d38b6-43d0-4243-8581-adeada7d073c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:25 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a47acc08-83ef-4dd5-ac9f-fc3a0b0d4703 tempest-ServersNegativeTestJSON-1310889834 None] Created volume successfully. Nov 05 11:59:25 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2 Nov 05 11:59:25 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:26 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2bd84b9a-c386-41a6-bb6b-62880a35d0a2" returned: 0 in 0.670s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-quobyte-2bd84b9a-c386-41a6-bb6b-62880a35d0a2" released by "delete_volume" :: held 1.612s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:26 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Created reservations ['f91b2161-125b-4da2-a18c-d7a5aa797fb7', 'ee16f9d2-401f-481f-b97b-f878eb239c88', '486a1734-5db2-46d0-8db8-8e7b535fe2ac', '741ba570-c9c2-4f25-a525-ebf2964e3a0e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:27 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:27 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "cinder-28ca83ff-de6d-4379-bcb4-d17af638d1a0-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-28ca83ff-de6d-4379-bcb4-d17af638d1a0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "cinder-quobyte-28ca83ff-de6d-4379-bcb4-d17af638d1a0" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-quobyte-28ca83ff-de6d-4379-bcb4-d17af638d1a0" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0710d73-df57-4ac0-97a2-1ed6d17d1cc6]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:27 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.506s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Deleted volume successfully. Nov 05 11:59:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-312412b5-a187-4689-b05e-c2cda8bb43b5 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-2bd84b9a-c386-41a6-bb6b-62880a35d0a2-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:27 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 Nov 05 11:59:27 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "cinder-3b5ece6a-1a89-41a1-9e23-acab471a0a28-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-3b5ece6a-1a89-41a1-9e23-acab471a0a28-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "cinder-quobyte-3b5ece6a-1a89-41a1-9e23-acab471a0a28" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-quobyte-3b5ece6a-1a89-41a1-9e23-acab471a0a28" acquired by "delete_volume" :: waited 0.036s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:28 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9c2b1e-981b-4719-ac90-f69848348829]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0" returned: 0 in 0.830s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:28 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0 Nov 05 11:59:28 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:28 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 Nov 05 11:59:28 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:28 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-28ca83ff-de6d-4379-bcb4-d17af638d1a0" returned: 0 in 0.428s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-quobyte-28ca83ff-de6d-4379-bcb4-d17af638d1a0" released by "delete_volume" :: held 1.348s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Created reservations ['c8569514-c0e6-4909-9557-d4c11c204d02', '1bfb3915-7048-4cf0-bca0-8863548eafb3', '754e4c5c-2b84-4cf4-8cb0-c63b2432371d', 'a0b22d44-dcbb-4b29-b009-c4a653a04a68'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:28 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28" returned: 0 in 0.634s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:29 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28 Nov 05 11:59:29 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:29 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:29 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:29 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.358s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:29 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Deleted volume successfully. Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3b5ece6a-1a89-41a1-9e23-acab471a0a28" returned: 0 in 0.481s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-quobyte-3b5ece6a-1a89-41a1-9e23-acab471a0a28" released by "delete_volume" :: held 1.179s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea3f83c1-d881-4dbd-ac4b-d9c3288e5471 tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-28ca83ff-de6d-4379-bcb4-d17af638d1a0-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Created reservations ['2ce627eb-b9fa-43d6-a1b0-7526dc0b8455', '267ada79-09db-439e-9fe4-5f6325df229b', '92e571ff-99af-4e36-97a9-92f4b54b8202', '283b3f53-1921-4e93-b661-30b34d1a3de5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:29 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:29 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "cinder-c550f420-4804-4828-ba13-8e9a9014d930-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-c550f420-4804-4828-ba13-8e9a9014d930-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "cinder-quobyte-c550f420-4804-4828-ba13-8e9a9014d930" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-quobyte-c550f420-4804-4828-ba13-8e9a9014d930" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bc6593-37ca-4a5d-a699-08cf1824aa83]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:30 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.464s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:30 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 Nov 05 11:59:30 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Deleted volume successfully. Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a0c5f0d1-9cbc-492f-8f8f-24a6a9717599 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-3b5ece6a-1a89-41a1-9e23-acab471a0a28-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:30 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930" returned: 0 in 0.571s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:30 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930 Nov 05 11:59:30 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "cinder-97eb660e-4b64-4e82-bb9a-693fd708528f-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-97eb660e-4b64-4e82-bb9a-693fd708528f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "cinder-quobyte-97eb660e-4b64-4e82-bb9a-693fd708528f" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-quobyte-97eb660e-4b64-4e82-bb9a-693fd708528f" acquired by "delete_volume" :: waited 0.045s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:30 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c550f420-4804-4828-ba13-8e9a9014d930" returned: 0 in 0.387s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-quobyte-c550f420-4804-4828-ba13-8e9a9014d930" released by "delete_volume" :: held 1.052s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[30637fd7-b376-4cc8-bbc7-76153f14516e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Created reservations ['e5609413-742b-4f0b-9921-f1018de1c34f', '0f69019a-bac5-4f26-bd49-82ab069e1123', '63fc4798-7cb6-4850-98ba-c24d03df12ef', '9874f766-3ff0-460c-b941-8819f726cf2e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:31 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f Nov 05 11:59:31 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:31 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:31 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:31 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f" returned: 0 in 0.620s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:31 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f Nov 05 11:59:31 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:31 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.422s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Deleted volume successfully. Nov 05 11:59:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edfa86c5-f048-4cbb-8e6e-9f3e873cc7bd tempest-ServersNegativeTestJSON-1310889834 None] Lock "cinder-c550f420-4804-4828-ba13-8e9a9014d930-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:32 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97eb660e-4b64-4e82-bb9a-693fd708528f" returned: 0 in 0.441s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-quobyte-97eb660e-4b64-4e82-bb9a-693fd708528f" released by "delete_volume" :: held 1.155s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Created reservations ['20302fc1-225f-4de8-9d53-ac603ac97c53', '86ca1fcf-38ba-4f85-80c1-1e59cc9aa6b8', '0e526295-9b7f-4973-9339-fa49e60e1292', '1a3bb83e-68fa-4871-b2bb-576329baea4b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:32 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:32 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:32 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.532s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Deleted volume successfully. Nov 05 11:59:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4294b670-8dcc-42de-95fa-aff7bacea616 tempest-AttachVolumeNegativeTest-1795982735 None] Lock "cinder-97eb660e-4b64-4e82-bb9a-693fd708528f-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:42 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=65,cinder:UPDATE=82,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:59:42 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=70,cinder:UPDATE=68,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Flow 'volume_create_manager' (bf234cf0-49ad-44d0-bdbd-7d14076fca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b65ed07-b06e-4a62-a86e-ec3aa742b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b65ed07-b06e-4a62-a86e-ec3aa742b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-564191611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54748cc8-2698-4b0c-98af-b4c863d101dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271dd7b3f555455fac253dfe6cef5da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:43Z,use_quota=True,user_id='8caa6160c3d64428bc945d245e0931ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0848fdd-f89e-4799-9ae1-372c4d15da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0848fdd-f89e-4799-9ae1-372c4d15da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0042d0-1708-4409-83ef-34ebaaff4f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0042d0-1708-4409-83ef-34ebaaff4f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54748cc8-2698-4b0c-98af-b4c863d101dd', 'volume_name': 'volume-54748cc8-2698-4b0c-98af-b4c863d101dd', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480146db-4bf7-4c86-8e97-bfa952566f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480146db-4bf7-4c86-8e97-bfa952566f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd7c612-8c2f-4d7a-adbc-59f6d39517de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:43 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Volume 54748cc8-2698-4b0c-98af-b4c863d101dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54748cc8-2698-4b0c-98af-b4c863d101dd', 'volume_size': 1} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-564191611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54748cc8-2698-4b0c-98af-b4c863d101dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271dd7b3f555455fac253dfe6cef5da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:43Z,use_quota=True,user_id='8caa6160c3d64428bc945d245e0931ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Creating volume 54748cc8-2698-4b0c-98af-b4c863d101dd {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:43 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:44 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd 1073741824 Nov 05 11:59:44 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:44 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd 1073741824" returned: 0 in 0.640s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:44 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd Nov 05 11:59:44 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:45 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd" returned: 0 in 0.376s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd7c612-8c2f-4d7a-adbc-59f6d39517de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54748cc8-2698-4b0c-98af-b4c863d101dd', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfc1a90-d9f5-424d-bbd9-547f2f1cee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:45 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Volume volume-54748cc8-2698-4b0c-98af-b4c863d101dd (54748cc8-2698-4b0c-98af-b4c863d101dd): created successfully Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfc1a90-d9f5-424d-bbd9-547f2f1cee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Flow 'volume_create_manager' (bf234cf0-49ad-44d0-bdbd-7d14076fca1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-017cc928-a8c5-4f2f-937f-86e40e494503 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Created volume successfully. Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Acquiring lock "cinder-54748cc8-2698-4b0c-98af-b4c863d101dd-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "cinder-54748cc8-2698-4b0c-98af-b4c863d101dd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Acquiring lock "cinder-quobyte-54748cc8-2698-4b0c-98af-b4c863d101dd" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "cinder-quobyte-54748cc8-2698-4b0c-98af-b4c863d101dd" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[90207a20-8911-4126-876c-257ae85dee94]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:45 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd Nov 05 11:59:45 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:46 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd" returned: 0 in 0.507s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:46 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd Nov 05 11:59:46 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:46 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-54748cc8-2698-4b0c-98af-b4c863d101dd" returned: 0 in 0.366s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "cinder-quobyte-54748cc8-2698-4b0c-98af-b4c863d101dd" released by "delete_volume" :: held 0.942s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Created reservations ['03383c3f-632a-4758-a2b9-db2c760a7a4e', '05a7162f-d54a-4d78-9296-5c399c1226cc', '73c64b57-3203-4f09-bab3-a5b7f3899ac3', '2bcd63da-7177-4cc3-aad1-98dfb125242e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:46 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:46 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:47 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.457s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:47 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Deleted volume successfully. Nov 05 11:59:47 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25b33758-120d-4b02-8cfa-6b510c92a1b7 tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "cinder-54748cc8-2698-4b0c-98af-b4c863d101dd-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3fa8fb8f-dd77-47fe-8096-b7a24e5c380c tempest-GroupsTest-465976259 None] Group tempest-Group1-539981657: creating Nov 05 11:59:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3fa8fb8f-dd77-47fe-8096-b7a24e5c380c tempest-GroupsTest-465976259 None] Group tempest-Group1-539981657: created successfully Nov 05 11:59:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3fa8fb8f-dd77-47fe-8096-b7a24e5c380c tempest-GroupsTest-465976259 None] Create group completed successfully. Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Flow 'volume_create_manager' (6f3d813a-d149-45d7-a34a-d59228d668ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6df93e2-6e81-402e-b4ab-b7bd6cd9993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6df93e2-6e81-402e-b4ab-b7bd6cd9993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2081439745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816ca8ce-d97b-46b2-b010-9019c8d75a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271dd7b3f555455fac253dfe6cef5da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:49Z,use_quota=True,user_id='8caa6160c3d64428bc945d245e0931ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb43eff7-82cc-4440-ae92-4c6b80663064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb43eff7-82cc-4440-ae92-4c6b80663064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83f2441-6626-4d4f-b631-d0454ae0bed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83f2441-6626-4d4f-b631-d0454ae0bed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816ca8ce-d97b-46b2-b010-9019c8d75a96', 'volume_name': 'volume-816ca8ce-d97b-46b2-b010-9019c8d75a96', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe6fe4-5d31-421c-b9f1-d21472c5ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe6fe4-5d31-421c-b9f1-d21472c5ad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96547080-de78-43f2-966f-a2f7ea00d31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Volume 816ca8ce-d97b-46b2-b010-9019c8d75a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816ca8ce-d97b-46b2-b010-9019c8d75a96', 'volume_size': 1} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2081439745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816ca8ce-d97b-46b2-b010-9019c8d75a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271dd7b3f555455fac253dfe6cef5da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:49Z,use_quota=True,user_id='8caa6160c3d64428bc945d245e0931ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Creating volume 816ca8ce-d97b-46b2-b010-9019c8d75a96 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:48 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:48 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 1073741824 Nov 05 11:59:48 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6387e1ec-3ac8-4ff2-96a1-5c881a5fd745 tempest-GroupsTest-465976259 None] Group tempest-Group2-350926697: creating Nov 05 11:59:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6387e1ec-3ac8-4ff2-96a1-5c881a5fd745 tempest-GroupsTest-465976259 None] Group tempest-Group2-350926697: created successfully Nov 05 11:59:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6387e1ec-3ac8-4ff2-96a1-5c881a5fd745 tempest-GroupsTest-465976259 None] Create group completed successfully. Nov 05 11:59:49 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 1073741824" returned: 0 in 0.879s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:49 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 Nov 05 11:59:49 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:50 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96" returned: 0 in 0.592s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96547080-de78-43f2-966f-a2f7ea00d31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816ca8ce-d97b-46b2-b010-9019c8d75a96', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea3e2f2-8fc8-4a99-8f41-aa191553eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Flow 'volume_create_manager' (8194ed6d-3fda-4011-8a01-c8a18df166fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471ca43e-e0dc-4946-b10e-71b755e6db52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:50 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Volume volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 (816ca8ce-d97b-46b2-b010-9019c8d75a96): created successfully Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea3e2f2-8fc8-4a99-8f41-aa191553eab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Flow 'volume_create_manager' (6f3d813a-d149-45d7-a34a-d59228d668ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471ca43e-e0dc-4946-b10e-71b755e6db52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1093232214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704a5105-7d2e-4920-9235-c95bf9edd5ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abab03534e2467d95d9cc3680ddaec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:50Z,use_quota=True,user_id='91262b24d64d485ba0379fe88de77042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e0dac3-f6c0-4361-9a57-f180e7ea6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e0dac3-f6c0-4361-9a57-f180e7ea6e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5c35b7-2d4c-42fa-83b4-617cce208fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5c35b7-2d4c-42fa-83b4-617cce208fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704a5105-7d2e-4920-9235-c95bf9edd5ed', 'volume_name': 'volume-704a5105-7d2e-4920-9235-c95bf9edd5ed', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875678fe-3ac1-4ab9-a7e3-3210963d7ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875678fe-3ac1-4ab9-a7e3-3210963d7ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790fd584-141c-4a71-b3d1-b9b2dc101fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:50 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Volume 704a5105-7d2e-4920-9235-c95bf9edd5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704a5105-7d2e-4920-9235-c95bf9edd5ed', 'volume_size': 1} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1093232214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704a5105-7d2e-4920-9235-c95bf9edd5ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abab03534e2467d95d9cc3680ddaec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:50Z,use_quota=True,user_id='91262b24d64d485ba0379fe88de77042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Creating volume 704a5105-7d2e-4920-9235-c95bf9edd5ed {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:50 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-eb8ad245-e94c-47c3-8178-f5412166653b tempest-VolumeQuotasAdminTestJSON-1264646563 None] Created volume successfully. Nov 05 11:59:50 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed 1073741824 Nov 05 11:59:50 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Flow 'volume_create_manager' (850e0381-935f-4b6b-a720-aba9e86fd0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee51913-da55-42cd-989f-5554ae02e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee51913-da55-42cd-989f-5554ae02e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-210216619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35a3f87e-9363-42b1-9c8f-6e42f9c4be69,host='devstack@QuobyteHD#QuobyteHD',id=df5fad6e-765a-470e-a2e8-4137871ef0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76f62c611da4b33a241a87287e4d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:51Z,use_quota=True,user_id='e75200c773874f94b79f3b2e6b641d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9679f35-99e8-4b59-b1d0-a2a91a7facb0),volume_type_id=d9679f35-99e8-4b59-b1d0-a2a91a7facb0)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98271b9b-7edd-410d-b870-c1f8723c53cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98271b9b-7edd-410d-b870-c1f8723c53cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:51 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8728a243-7cf6-46d6-bc01-8f4fc780b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8728a243-7cf6-46d6-bc01-8f4fc780b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df5fad6e-765a-470e-a2e8-4137871ef0ce', 'volume_name': 'volume-df5fad6e-765a-470e-a2e8-4137871ef0ce', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585a3920-c066-4fc7-9ae2-20afb62f8602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585a3920-c066-4fc7-9ae2-20afb62f8602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8737353a-afe2-432c-8bab-35e2c00d65e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Volume df5fad6e-765a-470e-a2e8-4137871ef0ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df5fad6e-765a-470e-a2e8-4137871ef0ce', 'volume_size': 1} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed 1073741824" returned: 0 in 0.766s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:51 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed Nov 05 11:59:51 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:51 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed" returned: 0 in 0.408s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35a3f87e-9363-42b1-9c8f-6e42f9c4be69,created_at=2026-11-05T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-210216619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35a3f87e-9363-42b1-9c8f-6e42f9c4be69,host='devstack@QuobyteHD#QuobyteHD',id=df5fad6e-765a-470e-a2e8-4137871ef0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76f62c611da4b33a241a87287e4d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:51Z,use_quota=True,user_id='e75200c773874f94b79f3b2e6b641d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9679f35-99e8-4b59-b1d0-a2a91a7facb0),volume_type_id=d9679f35-99e8-4b59-b1d0-a2a91a7facb0)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Creating volume df5fad6e-765a-470e-a2e8-4137871ef0ce {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:51 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790fd584-141c-4a71-b3d1-b9b2dc101fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704a5105-7d2e-4920-9235-c95bf9edd5ed', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:51 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce 1073741824 Nov 05 11:59:51 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a6c076-d069-45ef-b9ea-d736f2293cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Volume volume-704a5105-7d2e-4920-9235-c95bf9edd5ed (704a5105-7d2e-4920-9235-c95bf9edd5ed): created successfully Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a6c076-d069-45ef-b9ea-d736f2293cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Flow 'volume_create_manager' (8194ed6d-3fda-4011-8a01-c8a18df166fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8e94d4eb-4341-4840-9ae4-fc2b3385062d tempest-VolumesTestJSON-660778256 None] Created volume successfully. Nov 05 11:59:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-fd3e05bf-f18e-4c01-aa39-f3632f72ec31 req-d1448e76-46cf-40de-80cb-d1aecd26575a tempest-ServerActionsTestOtherA-1114459445 None] Terminate volume connection completed successfully. Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-fd3e05bf-f18e-4c01-aa39-f3632f72ec31 req-d1448e76-46cf-40de-80cb-d1aecd26575a tempest-ServerActionsTestOtherA-1114459445 None] Deleting attachment dfb99ab8-c743-425d-aec5-e12149b2d4d2. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:59:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-491ab9e0-0c73-40a1-8bbb-8aa928f0abd3 tempest-VolumeQuotasAdminTestJSON-1324285111 None] Transfer volume completed successfully. Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:52 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:52 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:52 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce 1073741824" returned: 0 in 0.743s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:52 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce Nov 05 11:59:52 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Acquiring lock "cinder-816ca8ce-d97b-46b2-b010-9019c8d75a96-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:52 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.408s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 8 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:59:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Lock "cinder-816ca8ce-d97b-46b2-b010-9019c8d75a96-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Acquiring lock "cinder-quobyte-816ca8ce-d97b-46b2-b010-9019c8d75a96" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Lock "cinder-quobyte-816ca8ce-d97b-46b2-b010-9019c8d75a96" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b13ae3-734b-45f3-b630-716f418fd7fc]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:53 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce" returned: 0 in 0.527s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8737353a-afe2-432c-8bab-35e2c00d65e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5fad6e-765a-470e-a2e8-4137871ef0ce', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ef0c06-3de6-4ce3-90b7-5646148b0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:53 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Volume volume-df5fad6e-765a-470e-a2e8-4137871ef0ce (df5fad6e-765a-470e-a2e8-4137871ef0ce): created successfully Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ef0c06-3de6-4ce3-90b7-5646148b0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Flow 'volume_create_manager' (850e0381-935f-4b6b-a720-aba9e86fd0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8c87f485-a138-496f-80d7-e9afd4e661cc tempest-GroupsTest-465976259 None] Created volume successfully. Nov 05 11:59:53 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 Nov 05 11:59:53 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Flow 'volume_create_manager' (73026266-86e5-428a-b7be-2f887c64b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578440f9-95ff-4c32-ac57-1a3939755825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578440f9-95ff-4c32-ac57-1a3939755825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-211830113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c518a26e-f8e3-4898-b436-02931698cf85,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abab03534e2467d95d9cc3680ddaec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:54Z,use_quota=True,user_id='91262b24d64d485ba0379fe88de77042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b5ffeb-899a-436a-ba70-c4d122ba8f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b5ffeb-899a-436a-ba70-c4d122ba8f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0ad95c-db78-485f-8f1b-f22cd0be498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0ad95c-db78-485f-8f1b-f22cd0be498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c518a26e-f8e3-4898-b436-02931698cf85', 'volume_name': 'volume-c518a26e-f8e3-4898-b436-02931698cf85', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a29bc9c-a934-4e91-b7ad-1a12471f93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a29bc9c-a934-4e91-b7ad-1a12471f93e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805364ff-14a3-41ec-9eb9-3b018b24da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:53 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Volume c518a26e-f8e3-4898-b436-02931698cf85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c518a26e-f8e3-4898-b436-02931698cf85', 'volume_size': 1} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-211830113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c518a26e-f8e3-4898-b436-02931698cf85,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abab03534e2467d95d9cc3680ddaec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:54Z,use_quota=True,user_id='91262b24d64d485ba0379fe88de77042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Creating volume c518a26e-f8e3-4898-b436-02931698cf85 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:53 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:53 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96" returned: 0 in 0.828s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:53 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 1073741824 Nov 05 11:59:53 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:54 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96 Nov 05 11:59:54 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:54 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-816ca8ce-d97b-46b2-b010-9019c8d75a96" returned: 0 in 0.541s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Lock "cinder-quobyte-816ca8ce-d97b-46b2-b010-9019c8d75a96" released by "delete_volume" :: held 1.441s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Created reservations ['1fdb913a-a2c4-4d59-a982-05529fe582f4', '7c7d9423-2e1c-4ba7-9679-b9a2a69385d5', '429189e4-8113-4cf2-8dd9-9e1e62b92ff0', '48e30fbb-a6c8-4e77-94da-090d0bacdfef'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:54 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:54 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:54 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 1073741824" returned: 0 in 0.982s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:55 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 Nov 05 11:59:55 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:55 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.516s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Deleted volume successfully. Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Acquiring lock "cinder-quobyte-df5fad6e-765a-470e-a2e8-4137871ef0ce" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1518d47e-07a9-4934-a3c5-6fd923917d1b tempest-VolumeQuotasAdminTestJSON-1333544789 None] Lock "cinder-816ca8ce-d97b-46b2-b010-9019c8d75a96-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Lock "cinder-quobyte-df5fad6e-765a-470e-a2e8-4137871ef0ce" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b3c6d-1f0f-43fa-bd4a-f130d298f440]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:55 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85" returned: 0 in 0.521s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805364ff-14a3-41ec-9eb9-3b018b24da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c518a26e-f8e3-4898-b436-02931698cf85', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d54b4eb-2815-454b-8fda-071615935f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:55 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Volume volume-c518a26e-f8e3-4898-b436-02931698cf85 (c518a26e-f8e3-4898-b436-02931698cf85): created successfully Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d54b4eb-2815-454b-8fda-071615935f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:55 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce Nov 05 11:59:55 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Flow 'volume_create_manager' (73026266-86e5-428a-b7be-2f887c64b21e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3888d52b-e59d-45af-9cb0-483f9af43dba tempest-VolumesTestJSON-660778256 None] Created volume successfully. Nov 05 11:59:55 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce" returned: 0 in 0.528s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:56 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce Nov 05 11:59:56 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:56 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-df5fad6e-765a-470e-a2e8-4137871ef0ce" returned: 0 in 0.545s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Lock "cinder-quobyte-df5fad6e-765a-470e-a2e8-4137871ef0ce" released by "delete_volume" :: held 1.167s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Created reservations ['7274ad94-7084-46b6-a6a9-1a48623f14c9'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:56 devstack cinder-volume[86942]: WARNING cinder.quota [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1672020160 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1672020160, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:59:56 devstack cinder-volume[86942]: WARNING cinder.quota [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1672020160 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1672020160, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Created reservations ['f2ab391e-0656-4c93-9692-5a882836a316', '58bfb579-b7d2-4f13-a1b7-30211737377f', 'cb68f8b3-031e-43f0-8142-8ade27bcdb47', '44bcb311-5a53-4b68-a616-0872744fccba'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Flow 'volume_create_manager' (5ee6e90a-e190-4049-b7d6-0ec4026f219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a15a448-9a26-435a-9d3f-5dcdc1e66940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a15a448-9a26-435a-9d3f-5dcdc1e66940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243405970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de45b4cc-19f8-4784-b3ad-13f5fba5b618,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abab03534e2467d95d9cc3680ddaec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:57Z,use_quota=True,user_id='91262b24d64d485ba0379fe88de77042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf24d12d-71e0-4de0-8b38-a4f4f14160f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf24d12d-71e0-4de0-8b38-a4f4f14160f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a212ab-2fc8-4b0b-85cb-183e88f2a8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a212ab-2fc8-4b0b-85cb-183e88f2a8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de45b4cc-19f8-4784-b3ad-13f5fba5b618', 'volume_name': 'volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a93a87-0f6c-4816-8fa5-c566709f34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a93a87-0f6c-4816-8fa5-c566709f34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba7cbff-e6a0-4b7e-a1ee-6cee0cb1054f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:56 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Volume de45b4cc-19f8-4784-b3ad-13f5fba5b618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618', 'volume_size': 1} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243405970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de45b4cc-19f8-4784-b3ad-13f5fba5b618,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abab03534e2467d95d9cc3680ddaec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:57Z,use_quota=True,user_id='91262b24d64d485ba0379fe88de77042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Creating volume de45b4cc-19f8-4784-b3ad-13f5fba5b618 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:59:56 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 11:59:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:57 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 1073741824 Nov 05 11:59:57 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:57 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:57 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:57 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.399s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bdedfdcd-acd6-47cd-9718-8f87fa11fd4c tempest-GroupsTest-465976259 None] Delete group completed successfully. Nov 05 11:59:57 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 1073741824" returned: 0 in 0.658s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:57 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 Nov 05 11:59:57 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:58 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618" returned: 0 in 0.352s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba7cbff-e6a0-4b7e-a1ee-6cee0cb1054f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11c8c51-a67e-4ede-b5c5-279e5884866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:59:58 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Volume volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 (de45b4cc-19f8-4784-b3ad-13f5fba5b618): created successfully Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11c8c51-a67e-4ede-b5c5-279e5884866d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Flow 'volume_create_manager' (5ee6e90a-e190-4049-b7d6-0ec4026f219a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:59:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b10bccac-3d93-4340-94c8-9df5960e5a6e tempest-VolumesTestJSON-660778256 None] Created volume successfully. Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Created reservations ['d2e5bd8d-de3c-4d5c-a906-da5536a1ba84'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:59:58 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 11:59:58 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:59:58 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.384s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:59:58 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:59:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c4b373ab-bfec-4007-90ba-53bb2db6b513 tempest-GroupsTest-465976259 None] Delete group completed successfully. Nov 05 12:00:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0a22efb1-4457-4bd6-82c5-e59822c803d3 tempest-GroupsTest-465976259 None] Group tempest-GroupsTest-Group-604067984: creating Nov 05 12:00:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0a22efb1-4457-4bd6-82c5-e59822c803d3 tempest-GroupsTest-465976259 None] Group tempest-GroupsTest-Group-604067984: created successfully Nov 05 12:00:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0a22efb1-4457-4bd6-82c5-e59822c803d3 tempest-GroupsTest-465976259 None] Create group completed successfully. Nov 05 12:00:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Acquiring lock "cinder-de45b4cc-19f8-4784-b3ad-13f5fba5b618-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Lock "cinder-de45b4cc-19f8-4784-b3ad-13f5fba5b618-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Acquiring lock "cinder-quobyte-de45b4cc-19f8-4784-b3ad-13f5fba5b618" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Lock "cinder-quobyte-de45b4cc-19f8-4784-b3ad-13f5fba5b618" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:00 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1899a231-4b19-4cca-9824-6d3ca6eb70e7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:00 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 Nov 05 12:00:00 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:01 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618" returned: 0 in 0.534s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:01 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618 Nov 05 12:00:01 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:01 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de45b4cc-19f8-4784-b3ad-13f5fba5b618" returned: 0 in 0.357s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Lock "cinder-quobyte-de45b4cc-19f8-4784-b3ad-13f5fba5b618" released by "delete_volume" :: held 0.967s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Created reservations ['c9bfa40d-9541-42bb-bda7-d7f9574bae6f', '463077a4-2b1c-4f44-a617-f4924536a796', '9895fa0d-369b-4741-be83-fa14d5c91801', '7e863fae-e836-4bc4-b745-601286461c64'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:01 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:00:01 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Flow 'volume_create_manager' (2955842b-db34-40b2-ac5d-5534d3240416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86e963e-6ebc-4892-a9e2-a42cf9b44913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86e963e-6ebc-4892-a9e2-a42cf9b44913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1387529084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c139aefd-4d0e-4ad6-9deb-9597a7526b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e27597cf574351964143cc7d1b27c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:02Z,use_quota=True,user_id='65b34b1bb1134870a37542e1972c5c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fc6fc5-1443-41af-8df5-ad120ca36419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fc6fc5-1443-41af-8df5-ad120ca36419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81cbe993-7e86-4c92-8f32-0c4b660a4913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:00:02 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.489s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:00:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Deleted volume successfully. Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e770c15a-7406-4a10-a27c-2737b40c24a5 tempest-VolumesTestJSON-660778256 None] Lock "cinder-de45b4cc-19f8-4784-b3ad-13f5fba5b618-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Flow 'volume_create_manager' (478b5225-e0c4-4b80-bfd4-d7f87218ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e454e2-9e72-4c0a-b69d-e3ccad459faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e454e2-9e72-4c0a-b69d-e3ccad459faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-665317780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5d8a12e-c030-4b22-8cff-f17a0c36fe63,host='devstack@QuobyteHD#QuobyteHD',id=fb2174a4-0972-4f2d-ace6-ebae16e86c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76f62c611da4b33a241a87287e4d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:03Z,use_quota=True,user_id='e75200c773874f94b79f3b2e6b641d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0086d3b2-f405-4ef1-a562-ca9077d8c6d7),volume_type_id=0086d3b2-f405-4ef1-a562-ca9077d8c6d7)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc22d68a-7c55-4d83-ad7b-0404d8baf7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc22d68a-7c55-4d83-ad7b-0404d8baf7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbb56a6-57a4-41b5-9ceb-1994a0bb220f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbb56a6-57a4-41b5-9ceb-1994a0bb220f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2174a4-0972-4f2d-ace6-ebae16e86c99', 'volume_name': 'volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576d68d0-e801-4013-b8f8-8df3920e288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576d68d0-e801-4013-b8f8-8df3920e288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9253560-82ea-4f92-a005-ef9ce5491a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:02 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Volume fb2174a4-0972-4f2d-ace6-ebae16e86c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99', 'volume_size': 1} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5d8a12e-c030-4b22-8cff-f17a0c36fe63,created_at=2026-11-05T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-665317780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5d8a12e-c030-4b22-8cff-f17a0c36fe63,host='devstack@QuobyteHD#QuobyteHD',id=fb2174a4-0972-4f2d-ace6-ebae16e86c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76f62c611da4b33a241a87287e4d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:03Z,use_quota=True,user_id='e75200c773874f94b79f3b2e6b641d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0086d3b2-f405-4ef1-a562-ca9077d8c6d7),volume_type_id=0086d3b2-f405-4ef1-a562-ca9077d8c6d7)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Creating volume fb2174a4-0972-4f2d-ace6-ebae16e86c99 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:00:02 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:00:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:02 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 1073741824 Nov 05 12:00:02 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Acquiring lock "cinder-c518a26e-f8e3-4898-b436-02931698cf85-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Lock "cinder-c518a26e-f8e3-4898-b436-02931698cf85-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81cbe993-7e86-4c92-8f32-0c4b660a4913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c139aefd-4d0e-4ad6-9deb-9597a7526b74', 'volume_name': 'volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a163b0b2-a3bb-4e23-8093-d283a87afb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a163b0b2-a3bb-4e23-8093-d283a87afb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87ab757-912b-430d-83e3-69b245161772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Volume c139aefd-4d0e-4ad6-9deb-9597a7526b74: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Trying to clone c139aefd-4d0e-4ad6-9deb-9597a7526b74 from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Acquiring lock "cinder-quobyte-c518a26e-f8e3-4898-b436-02931698cf85" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Lock "cinder-quobyte-c518a26e-f8e3-4898-b436-02931698cf85" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c79e22-1ffd-4857-9ad8-957f0a745d35]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:03 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 Nov 05 12:00:03 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:03 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 1073741824" returned: 0 in 0.952s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:00:03 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Image download 20.69 MB at 20.69 MB/s Nov 05 12:00:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a03081-566d-4302-b5ed-0ab483c03c88]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:04 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 Nov 05 12:00:04 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:04 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85" returned: 0 in 0.667s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:04 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85 Nov 05 12:00:04 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:04 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD Nov 05 12:00:04 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:04 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99" returned: 0 in 0.549s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9253560-82ea-4f92-a005-ef9ce5491a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:04 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65de523-0e94-4b13-8a56-e24dafd72698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c518a26e-f8e3-4898-b436-02931698cf85" returned: 0 in 0.500s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:04 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 is fetched for user 65b34b1bb1134870a37542e1972c5c98. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Lock "cinder-quobyte-c518a26e-f8e3-4898-b436-02931698cf85" released by "delete_volume" :: held 1.249s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:04 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Volume volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 (fb2174a4-0972-4f2d-ace6-ebae16e86c99): created successfully Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d65de523-0e94-4b13-8a56-e24dafd72698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Flow 'volume_create_manager' (478b5225-e0c4-4b80-bfd4-d7f87218ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8fc6d976-937f-4190-a54c-38e750dad21c tempest-GroupsTest-465976259 None] Created volume successfully. Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[61636833-ea2e-4ba1-bb1f-32d48ff3d264]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Created reservations ['79386cfd-ebb4-40e8-ba94-904eef3aa925', '202be4b1-0e72-4f97-bf7e-9556c7d5634d', '1dcb52c7-f8b8-45b1-b15f-16f5d9c49991', '416b59f9-7a8c-4b3b-b6d0-231c0b073b8a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:04 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD Nov 05 12:00:04 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:04 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:00:04 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:05 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.333s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:00:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Deleted volume successfully. Nov 05 12:00:05 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1387529084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c139aefd-4d0e-4ad6-9deb-9597a7526b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e27597cf574351964143cc7d1b27c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:02Z,use_quota=True,user_id='65b34b1bb1134870a37542e1972c5c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Creating volume c139aefd-4d0e-4ad6-9deb-9597a7526b74 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:00:05 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-459420d9-b8ff-49fd-aaf2-5ef4f71af896 tempest-VolumesTestJSON-660778256 None] Lock "cinder-c518a26e-f8e3-4898-b436-02931698cf85-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:05 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 1073741824 Nov 05 12:00:05 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Acquiring lock "cinder-704a5105-7d2e-4920-9235-c95bf9edd5ed-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Lock "cinder-704a5105-7d2e-4920-9235-c95bf9edd5ed-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Acquiring lock "cinder-quobyte-704a5105-7d2e-4920-9235-c95bf9edd5ed" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Lock "cinder-quobyte-704a5105-7d2e-4920-9235-c95bf9edd5ed" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c78ae57-771f-4e96-a94b-224d0e289024]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:05 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed Nov 05 12:00:05 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:06 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 1073741824" returned: 0 in 0.762s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:06 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 Nov 05 12:00:06 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Flow 'volume_create_manager' (9b15a2d7-8090-4d66-a91d-c30909d0839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cd3196-6bd7-4fb2-bb4e-98dd7763a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cd3196-6bd7-4fb2-bb4e-98dd7763a559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775458629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5d8a12e-c030-4b22-8cff-f17a0c36fe63,host='devstack@QuobyteHD#QuobyteHD',id=7c5737c1-45c6-4d5a-8b60-62b151bee5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76f62c611da4b33a241a87287e4d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:06Z,use_quota=True,user_id='e75200c773874f94b79f3b2e6b641d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0086d3b2-f405-4ef1-a562-ca9077d8c6d7),volume_type_id=0086d3b2-f405-4ef1-a562-ca9077d8c6d7)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9232df01-1ca3-4706-985e-06c9dcfadba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9232df01-1ca3-4706-985e-06c9dcfadba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6392b956-1121-43e9-87ae-f7f708760b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6392b956-1121-43e9-87ae-f7f708760b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5737c1-45c6-4d5a-8b60-62b151bee5e9', 'volume_name': 'volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36baec37-7f48-4a98-b6a6-c56b205811e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36baec37-7f48-4a98-b6a6-c56b205811e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e5df0b-39a6-4e88-8b34-b4544d177dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:06 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Volume 7c5737c1-45c6-4d5a-8b60-62b151bee5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9', 'volume_size': 1} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:06 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed" returned: 0 in 0.734s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:06 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed Nov 05 12:00:06 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:06 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74" returned: 0 in 0.405s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5d8a12e-c030-4b22-8cff-f17a0c36fe63,created_at=2026-11-05T11:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775458629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5d8a12e-c030-4b22-8cff-f17a0c36fe63,host='devstack@QuobyteHD#QuobyteHD',id=7c5737c1-45c6-4d5a-8b60-62b151bee5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76f62c611da4b33a241a87287e4d1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:06Z,use_quota=True,user_id='e75200c773874f94b79f3b2e6b641d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0086d3b2-f405-4ef1-a562-ca9077d8c6d7),volume_type_id=0086d3b2-f405-4ef1-a562-ca9077d8c6d7)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Creating volume 7c5737c1-45c6-4d5a-8b60-62b151bee5e9 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:00:06 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:06 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 1073741824 Nov 05 12:00:06 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Attempting download of 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume c139aefd-4d0e-4ad6-9deb-9597a7526b74. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5fd9b4-25a1-4196-9a35-6d88717dc598]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_ydyui7kv {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:06 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-704a5105-7d2e-4920-9235-c95bf9edd5ed" returned: 0 in 0.326s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Lock "cinder-quobyte-704a5105-7d2e-4920-9235-c95bf9edd5ed" released by "delete_volume" :: held 1.113s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Created reservations ['9cbd6d42-c811-460b-9792-78709f919f78', 'df226cef-467e-45ad-ad47-9c9587b4b3cf', 'ff1fc2a5-8cfc-4035-9cda-0b7a94422451', 'a343f8f2-46c0-48c5-b547-a1e5c01f2de1'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:06 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_ydyui7kv Nov 05 12:00:06 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:07 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:00:07 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:07 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_ydyui7kv" returned: 0 in 0.518s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_ydyui7kv {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:07 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 1073741824" returned: 0 in 0.696s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:07 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:07 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 Nov 05 12:00:07 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.405s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:07 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_ydyui7kv Nov 05 12:00:07 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:00:07 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Deleted volume successfully. Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5a434898-df70-4b6c-87b6-fb7d4d644725 tempest-VolumesTestJSON-660778256 None] Lock "cinder-704a5105-7d2e-4920-9235-c95bf9edd5ed-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:07 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_ydyui7kv" returned: 1 in 0.439s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_ydyui7kv' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5cdfc-e562-4374-9e9d-bc56f341ccb0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:07 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9" returned: 0 in 0.389s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e5df0b-39a6-4e88-8b34-b4544d177dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd93e28f-3cac-4c07-94e4-a47d116f9f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:07 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Volume volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 (7c5737c1-45c6-4d5a-8b60-62b151bee5e9): created successfully Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd93e28f-3cac-4c07-94e4-a47d116f9f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Flow 'volume_create_manager' (9b15a2d7-8090-4d66-a91d-c30909d0839b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:07 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3a104cd1-149e-493e-8189-44c8e48d6106 tempest-GroupsTest-465976259 None] Created volume successfully. Nov 05 12:00:07 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD Nov 05 12:00:07 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:08 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:08 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 was qcow2, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:00:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:08 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 Nov 05 12:00:08 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c4ff9dad-d9a2-4e9c-9e2b-7da43facb96f tempest-GroupsTest-465976259 None] Update group completed successfully. Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Flow 'volume_create_manager' (236fa030-56a8-48d4-b97c-95420c9608f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee0b0c9-03dc-481a-a97b-a487d11c2ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee0b0c9-03dc-481a-a97b-a487d11c2ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1989975085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c05016-c123-4701-b4fc-3467831a8990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13377ef45a594ba88a313e9f6c0156b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:10Z,use_quota=True,user_id='850e074961654644b68a265bff74d695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c06a46-1bad-42b0-91a9-7f79c66d75c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c06a46-1bad-42b0-91a9-7f79c66d75c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531118a1-d26b-4766-9844-05dd493580b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531118a1-d26b-4766-9844-05dd493580b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c05016-c123-4701-b4fc-3467831a8990', 'volume_name': 'volume-15c05016-c123-4701-b4fc-3467831a8990', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dcbbee-f5cd-42d9-87a1-6816777ff0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dcbbee-f5cd-42d9-87a1-6816777ff0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7975ca-8e2e-4883-8caf-fb3ca058ad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:10 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Volume 15c05016-c123-4701-b4fc-3467831a8990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c05016-c123-4701-b4fc-3467831a8990', 'volume_size': 1} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1989975085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c05016-c123-4701-b4fc-3467831a8990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13377ef45a594ba88a313e9f6c0156b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:10Z,use_quota=True,user_id='850e074961654644b68a265bff74d695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Creating volume 15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:00:10 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:00:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:10 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 1073741824 Nov 05 12:00:10 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f01cb74f-5669-4686-a039-5522db1a2e4c tempest-GroupsTest-465976259 None] Update group completed successfully. Nov 05 12:00:11 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74" returned: 0 in 2.952s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_o8ubnrobdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:00:11 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Converted 112.00 MB image at 37.92 MB/s Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:11 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 1G Nov 05 12:00:11 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:11 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 1073741824" returned: 0 in 0.735s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:11 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 Nov 05 12:00:11 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:11 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 1G" returned: 0 in 0.437s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Downloaded image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume c139aefd-4d0e-4ad6-9deb-9597a7526b74 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 for user 65b34b1bb1134870a37542e1972c5c98 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Marking volume c139aefd-4d0e-4ad6-9deb-9597a7526b74 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Copying metadata from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 to c139aefd-4d0e-4ad6-9deb-9597a7526b74. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Creating volume glance metadata for volume c139aefd-4d0e-4ad6-9deb-9597a7526b74 backed by image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:00:11 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990" returned: 0 in 0.305s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7975ca-8e2e-4883-8caf-fb3ca058ad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c05016-c123-4701-b4fc-3467831a8990', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0918d2-51d5-4cc3-9b13-c45ce5fd6e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:11 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Volume volume-15c05016-c123-4701-b4fc-3467831a8990 (15c05016-c123-4701-b4fc-3467831a8990): created successfully Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0918d2-51d5-4cc3-9b13-c45ce5fd6e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Flow 'volume_create_manager' (236fa030-56a8-48d4-b97c-95420c9608f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-45b64743-8c96-4445-8e87-8f7443bf4962 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Created volume successfully. Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87ab757-912b-430d-83e3-69b245161772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec19492-a2bb-49aa-8f1f-93ed75365534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:11 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Volume volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 (c139aefd-4d0e-4ad6-9deb-9597a7526b74): created successfully Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec19492-a2bb-49aa-8f1f-93ed75365534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Flow 'volume_create_manager' (2955842b-db34-40b2-ac5d-5534d3240416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8f47d2aa-c1b2-40d9-afe2-dcf2e14f573d tempest-ServerActionsTestOtherA-1114459445 None] Created volume successfully. Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Acquiring lock "cinder-quobyte-7c5737c1-45c6-4d5a-8b60-62b151bee5e9" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Lock "cinder-quobyte-7c5737c1-45c6-4d5a-8b60-62b151bee5e9" acquired by "delete_volume" :: waited 0.041s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8de0e-4e3e-4d0d-8f7f-893f6d97cb6a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Creating offline snapshot a1120b31-ba81-41c1-929c-ae1d9b39166f of volume 15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b2652-c977-406f-a0f9-c00c26dd0f8b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:12 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 Nov 05 12:00:12 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:12 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 Nov 05 12:00:12 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:13 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9" returned: 0 in 0.529s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:13 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9 Nov 05 12:00:13 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:13 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990" returned: 0 in 0.527s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:13 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f 1G Nov 05 12:00:13 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:13 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c5737c1-45c6-4d5a-8b60-62b151bee5e9" returned: 0 in 0.335s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Lock "cinder-quobyte-7c5737c1-45c6-4d5a-8b60-62b151bee5e9" released by "delete_volume" :: held 0.953s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Acquiring lock "cinder-quobyte-fb2174a4-0972-4f2d-ace6-ebae16e86c99" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Lock "cinder-quobyte-fb2174a4-0972-4f2d-ace6-ebae16e86c99" acquired by "delete_volume" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ddeee-b978-48b1-b3d7-b046da7ad8d4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:14 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 Nov 05 12:00:14 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:14 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f 1G" returned: 0 in 0.693s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c05016-c123-4701-b4fc-3467831a8990 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:14 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c05016-c123-4701-b4fc-3467831a8990 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f Nov 05 12:00:14 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:14 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99" returned: 0 in 0.693s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:14 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99 Nov 05 12:00:14 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:14 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c05016-c123-4701-b4fc-3467831a8990 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f" returned: 0 in 0.419s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:14 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f is being set with open permissions: ugo+rw Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:14 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f Nov 05 12:00:14 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:14 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb2174a4-0972-4f2d-ace6-ebae16e86c99" returned: 0 in 0.348s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Lock "cinder-quobyte-fb2174a4-0972-4f2d-ace6-ebae16e86c99" released by "delete_volume" :: held 1.113s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:14 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:14 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Created reservations ['b4f5802f-ff65-4460-a493-114645426b25'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:14 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.info Nov 05 12:00:14 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:14 devstack cinder-volume[86942]: WARNING cinder.quota [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-931242297 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-931242297, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:00:14 devstack cinder-volume[86942]: WARNING cinder.quota [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-931242297 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-931242297, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Created reservations ['0e0bf61e-f1e6-4c94-b172-be68cedba6c5', 'd7a30fc6-1c22-4183-a2fe-0ff2ec857c49', '778e42d4-233f-4b0d-8aa1-525b17324905', 'cbf6984f-d5e0-4e32-a538-de912d743354'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Created reservations ['3a895053-3fd0-43af-8774-638f97fb865a', '5b87c362-2fda-49bb-89d6-4878c07ebbb1', 'fc40cbb3-cba8-46ef-b233-22a9da16c8b7', '3044a1a5-bc1e-448b-8201-a1e1e1eac54e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:15 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.info" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:15 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.info is being set with open permissions: ugo+rw Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:15 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.info Nov 05 12:00:15 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:15 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:00:15 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:15 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.info" returned: 0 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.059s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9784b843-1507-4b06-816e-a1cc946335db tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Create snapshot completed successfully Nov 05 12:00:15 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.377s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:15 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:00:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e2da00e6-b086-4743-bd8c-2473ced1e77a tempest-GroupsTest-465976259 None] Delete group completed successfully. Nov 05 12:00:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-cdc3b62f-d634-45e7-a05a-b12dae911ba5 req-e398ee8e-43c2-407f-85bb-17f1e3dfa831 tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-cdc3b62f-d634-45e7-a05a-b12dae911ba5 req-e398ee8e-43c2-407f-85bb-17f1e3dfa831 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-cdc3b62f-d634-45e7-a05a-b12dae911ba5 req-e398ee8e-43c2-407f-85bb-17f1e3dfa831 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-cdc3b62f-d634-45e7-a05a-b12dae911ba5 req-e398ee8e-43c2-407f-85bb-17f1e3dfa831 tempest-ServerActionsTestOtherA-1114459445 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7967112-04f0-44a4-a3e7-b2a27c7e0926', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:00:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-cdc3b62f-d634-45e7-a05a-b12dae911ba5 req-e398ee8e-43c2-407f-85bb-17f1e3dfa831 tempest-ServerActionsTestOtherA-1114459445 None] attachment_update completed successfully. Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "cinder-a1120b31-ba81-41c1-929c-ae1d9b39166f-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-a1120b31-ba81-41c1-929c-ae1d9b39166f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "cinder-quobyte-15c05016-c123-4701-b4fc-3467831a8990" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-quobyte-15c05016-c123-4701-b4fc-3467831a8990" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "cinder-quobyte-a1120b31-ba81-41c1-929c-ae1d9b39166f" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-quobyte-a1120b31-ba81-41c1-929c-ae1d9b39166f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Deleting offline snapshot a1120b31-ba81-41c1-929c-ae1d9b39166f of volume 15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] snapshot_file for this snap is: volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fcc64-0a7c-411e-a0ba-7999e74d82f0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:18 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f Nov 05 12:00:18 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:18 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f" returned: 0 in 0.556s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15c05016-c123-4701-b4fc-3467831a8990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:18 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[618da858-56e0-46fc-adb2-12af20b90345]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:18 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 Nov 05 12:00:18 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:19 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990" returned: 0 in 0.558s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:19 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f Nov 05 12:00:19 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:19 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f" returned: 0 in 0.607s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:19 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f Nov 05 12:00:19 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:20 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990.a1120b31-ba81-41c1-929c-ae1d9b39166f" returned: 0 in 0.395s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-quobyte-a1120b31-ba81-41c1-929c-ae1d9b39166f" released by "_delete_snapshot" :: held 2.355s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-quobyte-15c05016-c123-4701-b4fc-3467831a8990" released by "delete_snapshot" :: held 2.402s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:20 devstack cinder-volume[86942]: WARNING cinder.quota [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:00:20 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Created reservations ['23c95085-6e21-45a5-a990-c65182de5705', '2db1fbc9-696e-413d-8e88-e1bd1e4544bd', 'e97f8dec-c2bb-4212-8a02-c1d50979d5ae', '9ecdc0e6-450e-4bd8-a39b-0df206d5e9eb'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Delete snapshot completed successfully. Nov 05 12:00:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-625154b0-e287-4a4c-8969-74b6f6ef62d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-a1120b31-ba81-41c1-929c-ae1d9b39166f-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "cinder-15c05016-c123-4701-b4fc-3467831a8990-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-15c05016-c123-4701-b4fc-3467831a8990-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "cinder-quobyte-15c05016-c123-4701-b4fc-3467831a8990" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-quobyte-15c05016-c123-4701-b4fc-3467831a8990" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:21 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[467764b2-6a14-4912-967e-e2e3837ba06f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:21 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 Nov 05 12:00:21 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-202b39ee-40dc-4c7a-99ff-13a8cedc2b6c tempest-BackendsCapabilitiesAdminTestsJSON-481740899 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3944854736328, 'free_capacity_gb': 1773.3944854736328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86942) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 12:00:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d99be930-bf9d-41fc-9d2c-04167b628228 tempest-BackendsCapabilitiesAdminTestsJSON-481740899 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3944854736328, 'free_capacity_gb': 1773.3944854736328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86942) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 12:00:22 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990" returned: 0 in 0.937s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:22 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990 Nov 05 12:00:22 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:23 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-15c05016-c123-4701-b4fc-3467831a8990" returned: 0 in 0.529s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-quobyte-15c05016-c123-4701-b4fc-3467831a8990" released by "delete_volume" :: held 1.595s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Created reservations ['8f11ac71-515c-4455-abcd-97628d34c3f1', '685322a7-f4c2-45b5-bad9-ff2881f3b3e4', '8e69610e-f218-4bc0-8dbe-2280daea25f4', 'f3daac80-55cb-42d9-80a5-530b1c26ed5b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:23 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:00:23 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:23 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.470s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:00:23 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Deleted volume successfully. Nov 05 12:00:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9c94e583-64c8-4848-ac06-a3da9677687e tempest-VolumeSnapshotQuotasNegativeTestJSON-919835297 None] Lock "cinder-15c05016-c123-4701-b4fc-3467831a8990-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Flow 'volume_create_manager' (2357c0ee-e3fd-4902-8b0c-6b20e9e17531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8252e74d-c689-4e51-95b5-b53cbb270bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8252e74d-c689-4e51-95b5-b53cbb270bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1613746021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8128a681-a32f-42a8-99cf-f9dcc594b4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d41eefba0824233a31ef8f8106925b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:31Z,use_quota=True,user_id='49642de4419a4c898870de94ab77a097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04174a7-6fc6-4259-87fd-76e2c9868f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04174a7-6fc6-4259-87fd-76e2c9868f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4c6aa8-b72f-4049-b12c-815a8ee7e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4c6aa8-b72f-4049-b12c-815a8ee7e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8128a681-a32f-42a8-99cf-f9dcc594b4cc', 'volume_name': 'volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1befbe75-65b8-4b4c-863a-da9ab848dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1befbe75-65b8-4b4c-863a-da9ab848dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59251c95-31fa-4d9d-a656-0f37714e7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc', 'volume_size': 1} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1613746021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8128a681-a32f-42a8-99cf-f9dcc594b4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d41eefba0824233a31ef8f8106925b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:31Z,use_quota=True,user_id='49642de4419a4c898870de94ab77a097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Creating volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:00:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:00:31 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:00:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:31 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc 1073741824 Nov 05 12:00:31 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:32 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc 1073741824" returned: 0 in 1.457s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:32 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc Nov 05 12:00:32 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:33 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc" returned: 0 in 0.567s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:00:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59251c95-31fa-4d9d-a656-0f37714e7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab0b1a1-7018-4069-90d6-ef114a1baedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Volume volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc (8128a681-a32f-42a8-99cf-f9dcc594b4cc): created successfully Nov 05 12:00:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab0b1a1-7018-4069-90d6-ef114a1baedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Flow 'volume_create_manager' (2357c0ee-e3fd-4902-8b0c-6b20e9e17531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7d5b4598-71ad-4067-a517-23c193b0935a tempest-SnapshotsActionsTest-2058063200 None] Created volume successfully. Nov 05 12:00:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Creating offline snapshot 5acc93a4-ab8b-4926-a778-6c13685bf65b of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:00:34 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f73969c-52e9-41c3-b097-65f566926b7d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:34 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc Nov 05 12:00:34 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:35 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc" returned: 0 in 0.757s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:35 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b 1G Nov 05 12:00:35 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:36 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b 1G" returned: 0 in 0.886s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:36 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:00:36 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:37 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.724s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:37 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b is being set with open permissions: ugo+rw Nov 05 12:00:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:37 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:00:37 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:37 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.705s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:37 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.info Nov 05 12:00:37 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b1ad3f27-50b6-49ba-bea6-e1e6275a9ff6 tempest-GroupSnapshotsTest-2112745905 None] Group tempest-GroupSnapshotsTest-Group-512345198: creating Nov 05 12:00:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b1ad3f27-50b6-49ba-bea6-e1e6275a9ff6 tempest-GroupSnapshotsTest-2112745905 None] Group tempest-GroupSnapshotsTest-Group-512345198: created successfully Nov 05 12:00:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b1ad3f27-50b6-49ba-bea6-e1e6275a9ff6 tempest-GroupSnapshotsTest-2112745905 None] Create group completed successfully. Nov 05 12:00:38 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.info" returned: 0 in 0.640s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:38 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.info is being set with open permissions: ugo+rw Nov 05 12:00:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:38 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.info Nov 05 12:00:38 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:38 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.info" returned: 0 in 0.362s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-47b30198-467d-4568-887f-73f32a6b0c06 tempest-SnapshotsActionsTest-2058063200 None] Create snapshot completed successfully Nov 05 12:00:40 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-08bb9b7c-7d12-4c3c-8d47-c1aa39e1fd02 req-3973a73d-fda5-45f9-81df-0ed34e19b58d tempest-ServerActionsTestOtherA-1114459445 None] Terminate volume connection completed successfully. Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-08bb9b7c-7d12-4c3c-8d47-c1aa39e1fd02 req-3973a73d-fda5-45f9-81df-0ed34e19b58d tempest-ServerActionsTestOtherA-1114459445 None] Deleting attachment f7967112-04f0-44a4-a3e7-b2a27c7e0926. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (5241e4ce-691c-4fcb-868c-3730399e0647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd2f586-1cfb-4c72-9adb-77c86c0786c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd2f586-1cfb-4c72-9adb-77c86c0786c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742872874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fe35d3c-2906-46c0-b2ae-8dc04d291580,host='devstack@QuobyteHD#QuobyteHD',id=b75bc742-fe62-407f-ab45-a1f8e8ea364a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:40Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b0827f2-a4ca-409d-8375-b13955ce8ca8),volume_type_id=8b0827f2-a4ca-409d-8375-b13955ce8ca8)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879faa1f-b39c-4951-bbcd-58eeabf635f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879faa1f-b39c-4951-bbcd-58eeabf635f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3841e3b-6710-49e6-bff3-bf986448e328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3841e3b-6710-49e6-bff3-bf986448e328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75bc742-fe62-407f-ab45-a1f8e8ea364a', 'volume_name': 'volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a73e25-2336-4830-b77d-09db0cf55d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a73e25-2336-4830-b77d-09db0cf55d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6f978b-cde2-4039-91c9-ae75c9dd03b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:40 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Volume b75bc742-fe62-407f-ab45-a1f8e8ea364a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a', 'volume_size': 1} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fe35d3c-2906-46c0-b2ae-8dc04d291580,created_at=2026-11-05T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742872874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fe35d3c-2906-46c0-b2ae-8dc04d291580,host='devstack@QuobyteHD#QuobyteHD',id=b75bc742-fe62-407f-ab45-a1f8e8ea364a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:40Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b0827f2-a4ca-409d-8375-b13955ce8ca8),volume_type_id=8b0827f2-a4ca-409d-8375-b13955ce8ca8)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Creating volume b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:00:40 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:00:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:40 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a 1073741824 Nov 05 12:00:40 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:41 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a 1073741824" returned: 0 in 0.703s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:41 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a Nov 05 12:00:41 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:41 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a" returned: 0 in 0.409s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.405s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6f978b-cde2-4039-91c9-ae75c9dd03b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dee1915-104d-49fe-bc6d-4ddac5df393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Creating offline snapshot c34273a0-a0ed-4ba1-9d48-c4e036bba040 of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:00:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Volume volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a (b75bc742-fe62-407f-ab45-a1f8e8ea364a): created successfully Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dee1915-104d-49fe-bc6d-4ddac5df393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (5241e4ce-691c-4fcb-868c-3730399e0647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a0dafb-4ac2-47a8-9962-c00f5923e11a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-52ac8bbe-bc0e-47aa-b5a8-1625a6f28522 tempest-GroupSnapshotsTest-2112745905 None] Created volume successfully. Nov 05 12:00:41 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:00:41 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:42 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.510s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:42 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 1G Nov 05 12:00:42 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-08bb9b7c-7d12-4c3c-8d47-c1aa39e1fd02 req-ec92a3b4-29f4-4de7-ba12-47b30a2132a4 tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:42 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 1G" returned: 0 in 0.656s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:42 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 Nov 05 12:00:42 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] GroupSnapshot 2a22c1a8-3d0f-4ec1-9302-99b46b2f1da0: creating. Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=130,cinder:UPDATE=138,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=130,cinder:SELECT=116,cinder:INSERT=34,cinder:DELETE=11 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Group snapshot 2a22c1a8-3d0f-4ec1-9302-99b46b2f1da0: creating. {{(pid=86942) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:43 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040" returned: 0 in 0.436s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:43 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 is being set with open permissions: ugo+rw Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:43 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 Nov 05 12:00:43 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:43 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040" returned: 0 in 0.281s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-08bb9b7c-7d12-4c3c-8d47-c1aa39e1fd02 req-ec92a3b4-29f4-4de7-ba12-47b30a2132a4 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.105s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-08bb9b7c-7d12-4c3c-8d47-c1aa39e1fd02 req-ec92a3b4-29f4-4de7-ba12-47b30a2132a4 tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.628s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Creating offline snapshot 40afe232-c936-4788-b650-36f9bb16140d of volume b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:00:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6ed86035-8bad-4f37-896a-4a89c7011900 tempest-SnapshotsActionsTest-2058063200 None] Create snapshot completed successfully Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c761865-093f-4512-8b02-22397c66376c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-08bb9b7c-7d12-4c3c-8d47-c1aa39e1fd02 req-ec92a3b4-29f4-4de7-ba12-47b30a2132a4 tempest-ServerActionsTestOtherA-1114459445 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4417b295-d082-4e8a-aa30-7c38cbb22ad0', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:00:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-08bb9b7c-7d12-4c3c-8d47-c1aa39e1fd02 req-ec92a3b4-29f4-4de7-ba12-47b30a2132a4 tempest-ServerActionsTestOtherA-1114459445 None] attachment_update completed successfully. Nov 05 12:00:43 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a Nov 05 12:00:43 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:44 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a" returned: 0 in 0.559s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:44 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d 1G Nov 05 12:00:44 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-c34273a0-a0ed-4ba1-9d48-c4e036bba040-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-c34273a0-a0ed-4ba1-9d48-c4e036bba040-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-c34273a0-a0ed-4ba1-9d48-c4e036bba040" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-c34273a0-a0ed-4ba1-9d48-c4e036bba040" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Deleting offline snapshot c34273a0-a0ed-4ba1-9d48-c4e036bba040 of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] snapshot_file for this snap is: volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e537d2a-e1e3-4c11-8251-f61a8b6afc6f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:45 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 Nov 05 12:00:45 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:45 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d 1G" returned: 0 in 0.904s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:45 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d Nov 05 12:00:45 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:45 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040" returned: 0 in 0.955s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ea4bfe-fd55-4c55-86f6-291ec2d988b7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:45 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d" returned: 0 in 0.652s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:45 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:00:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:46 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d Nov 05 12:00:46 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:46 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:00:46 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:46 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d" returned: 0 in 0.572s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:46 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.721s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:46 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.info Nov 05 12:00:46 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:46 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 Nov 05 12:00:46 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:47 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.info" returned: 0 in 0.491s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:47 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:47 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.info Nov 05 12:00:47 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:47 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040" returned: 0 in 0.574s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:47 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040 Nov 05 12:00:47 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:47 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.info" returned: 0 in 0.386s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.782s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f262481c-fb55-4962-849b-959a7dd64228 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 2a22c1a8-3d0f-4ec1-9302-99b46b2f1da0: created successfully Nov 05 12:00:47 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.c34273a0-a0ed-4ba1-9d48-c4e036bba040" returned: 0 in 0.676s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-c34273a0-a0ed-4ba1-9d48-c4e036bba040" released by "_delete_snapshot" :: held 3.144s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:47 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" released by "delete_snapshot" :: held 3.192s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:48 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Created reservations ['960bb50a-c087-4e0d-8aed-08cdf10b95ff', '86e643aa-2fd3-4ffa-ac21-e23e7d182a4a', 'e394be3a-2a38-461b-876a-0a3e814bfbd7', 'e777065d-afdf-49e8-b9b3-bdfff80157a4'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Delete snapshot completed successfully. Nov 05 12:00:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89441614-15d4-4de4-b711-d3b95d138c13 tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-c34273a0-a0ed-4ba1-9d48-c4e036bba040-delete_snapshot" released by "delete_snapshot" :: held 3.453s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Creating offline snapshot ab3847f8-be0c-401e-aaf9-c2146630ca0f of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:00:49 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc6866-d7ed-4f0c-a0e9-b70ba8517c01]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:50 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:00:50 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:51 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 1.127s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:51 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f 1G Nov 05 12:00:51 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:52 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f 1G" returned: 0 in 1.175s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:52 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f Nov 05 12:00:52 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:00:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:00:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:00:52 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f" returned: 0 in 0.727s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:52 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f is being set with open permissions: ugo+rw Nov 05 12:00:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:52 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f Nov 05 12:00:53 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:53 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f" returned: 0 in 0.522s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.741s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.803s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-40afe232-c936-4788-b650-36f9bb16140d-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-75d7e2da-95b8-49e5-992e-9d3eab2d984a tempest-SnapshotsActionsTest-2058063200 None] Create snapshot completed successfully Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-40afe232-c936-4788-b650-36f9bb16140d-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" acquired by "_create_volume_from_snapshot" :: waited 0.082s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Creating volume 6fb5c87f-02ae-4132-b4ba-9ed1126850a0 from snapshot 40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] snapshot: 40afe232-c936-4788-b650-36f9bb16140d, volume: 6fb5c87f-02ae-4132-b4ba-9ed1126850a0, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6474d7-dea4-4b5a-b7e5-e6285f639f19]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:54 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d Nov 05 12:00:54 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:54 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d" returned: 0 in 0.746s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c83a34-3ef6-425b-ba99-357747401968]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:54 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a Nov 05 12:00:54 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-ab3847f8-be0c-401e-aaf9-c2146630ca0f-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-ab3847f8-be0c-401e-aaf9-c2146630ca0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-ab3847f8-be0c-401e-aaf9-c2146630ca0f" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-ab3847f8-be0c-401e-aaf9-c2146630ca0f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Deleting offline snapshot ab3847f8-be0c-401e-aaf9-c2146630ca0f of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] snapshot_file for this snap is: volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d98d34-ae73-4842-8411-7c6e9a2b8bd6]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:55 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f Nov 05 12:00:55 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:55 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a" returned: 0 in 0.776s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:55 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 Nov 05 12:00:55 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:55 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f" returned: 0 in 0.673s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b28bb09-7260-492d-98bd-eeb36c96655e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:00:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:56 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:00:56 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:56 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 1.033s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:00:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:57 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f Nov 05 12:00:57 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:58 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f" returned: 0 in 1.340s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:00:58 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f Nov 05 12:00:58 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:00:59 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Nov 05 12:00:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ab3847f8-be0c-401e-aaf9-c2146630ca0f" returned: 0 in 0.816s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:00:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-ab3847f8-be0c-401e-aaf9-c2146630ca0f" released by "_delete_snapshot" :: held 4.117s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" released by "delete_snapshot" :: held 4.161s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:00:59 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Created reservations ['604e5b31-3fe7-436c-81e9-13fd80264e63', '88f0e30a-0012-4450-abd0-e9455d83a042', '8f0471a8-c1aa-4057-a5a8-3f5476b388fa', '9ea188fa-43e2-48ac-be6d-454a7fd6090e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:00:59 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Delete snapshot completed successfully. Nov 05 12:00:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9dbeed06-411c-4ee2-8c25-8061ee2f27bb tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-ab3847f8-be0c-401e-aaf9-c2146630ca0f-delete_snapshot" released by "delete_snapshot" :: held 4.695s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:06 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" returned: 0 in 10.759s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a, size 1024.00 MB, duration 10.76 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:01:06 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Converted 1024.00 MB image at 95.16 MB/s Nov 05 12:01:06 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:06 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 Nov 05 12:01:06 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:06 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" returned: 0 in 0.329s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" released by "_copy_volume_from_snapshot" :: held 12.803s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-40afe232-c936-4788-b650-36f9bb16140d-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" released by "_create_volume_from_snapshot" :: held 12.941s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.027s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.452s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Creating offline snapshot ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f51bbfc-1fab-42e4-b7b2-dff13236571b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-89bb9153-e9de-4863-8cf3-608995c6f97e tempest-GroupSnapshotsTest-2112745905 None] Create group from source-snapshot-2a22c1a8-3d0f-4ec1-9302-99b46b2f1da0 completed successfully. Nov 05 12:01:06 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:01:06 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:07 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.562s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:07 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 1G Nov 05 12:01:07 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15fe808-b002-47ac-a715-0283c32d7b3b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:07 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 1G" returned: 0 in 0.659s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:07 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 Nov 05 12:01:07 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:07 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 Nov 05 12:01:07 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:08 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" returned: 0 in 0.447s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:08 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" returned: 0 in 0.363s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:08 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 is being set with open permissions: ugo+rw Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:08 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0 Nov 05 12:01:08 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:08 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 Nov 05 12:01:08 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:08 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-6fb5c87f-02ae-4132-b4ba-9ed1126850a0" released by "delete_volume" :: held 0.803s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:08 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" returned: 0 in 0.323s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a30093ab-5629-4b06-b7eb-76bcec2cab26 tempest-SnapshotsActionsTest-2058063200 None] Create snapshot completed successfully Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['184cb124-d76c-4c57-adf3-5668a6a5d0ee'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:08 devstack cinder-volume[86942]: WARNING cinder.quota [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2076465681 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2076465681, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:08 devstack cinder-volume[86942]: WARNING cinder.quota [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2076465681 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2076465681, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['da1677c8-3c42-4669-ae98-5f322f874751', '6b807634-4335-41f4-a44f-a246d219c3a2', '5e978007-35c9-4e7e-9cc5-d36e6d547cc5', '3cdaefa3-3e15-4c07-8d89-8e047f395b8d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:08 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:08 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 2a22c1a8-3d0f-4ec1-9302-99b46b2f1da0: deleting Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 2a22c1a8-3d0f-4ec1-9302-99b46b2f1da0: deleting {{(pid=86942) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-b75bc742-fe62-407f-ab45-a1f8e8ea364a" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:09 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-b75bc742-fe62-407f-ab45-a1f8e8ea364a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-40afe232-c936-4788-b650-36f9bb16140d" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.346s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-07d721bf-a6cc-40ca-aedb-eaf856bb267b tempest-GroupSnapshotsTest-2112745905 None] Delete group completed successfully. Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-40afe232-c936-4788-b650-36f9bb16140d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Deleting offline snapshot 40afe232-c936-4788-b650-36f9bb16140d of volume b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] snapshot_file for this snap is: volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c230b8-05d8-434d-b7d0-f270afc6112a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:09 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d Nov 05 12:01:09 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-ad528fc7-1a41-4d73-89ed-e7ae4b47aac0-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:09 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d" returned: 0 in 0.440s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-ad528fc7-1a41-4d73-89ed-e7ae4b47aac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07bd159-79c4-4068-a009-8cd7a628197d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Deleting offline snapshot ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] snapshot_file for this snap is: volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c19d545-2a73-4d6a-9650-9b75a3b191cc]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:09 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a Nov 05 12:01:09 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:10 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 Nov 05 12:01:10 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:10 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" returned: 0 in 0.436s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[66990262-8063-44b3-9918-14565d5ae000]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:10 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a" returned: 0 in 0.643s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:10 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d Nov 05 12:01:10 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:10 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:01:10 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:10 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.504s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:10 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d" returned: 0 in 0.453s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:10 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 Nov 05 12:01:10 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:10 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d Nov 05 12:01:10 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:11 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a.40afe232-c936-4788-b650-36f9bb16140d" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-40afe232-c936-4788-b650-36f9bb16140d" released by "_delete_snapshot" :: held 2.023s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-b75bc742-fe62-407f-ab45-a1f8e8ea364a" released by "delete_snapshot" :: held 2.067s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:11 devstack cinder-volume[86942]: WARNING cinder.quota [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2076465681 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2076465681, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['ce4fb4f0-f77e-45f6-8c72-a14bd177bb1c', '97c1e7d2-9c43-4bb1-a019-d89de04f7f61', '36999000-9161-4a04-9b86-3afc08dc9316', '834d4b6b-561a-4d54-b4cd-ea913a1adfab'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:11 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" returned: 0 in 0.599s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:11 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0 Nov 05 12:01:11 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-61b920d7-5f54-465d-ac87-2360ab57f685 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 2a22c1a8-3d0f-4ec1-9302-99b46b2f1da0: deleted successfully Nov 05 12:01:11 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" returned: 0 in 0.307s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-ad528fc7-1a41-4d73-89ed-e7ae4b47aac0" released by "_delete_snapshot" :: held 1.993s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" released by "delete_snapshot" :: held 2.027s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:11 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Created reservations ['957df886-b5dd-4acd-8aa2-b00abe6c8bfd', 'e1c56c3a-5a9f-4bc0-8ad3-ae74450f04bc', 'c909bee7-0606-4fd0-97f7-99081c8553df', '468d0bf7-41a5-4028-aaed-5be4ddb30b94'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Delete snapshot completed successfully. Nov 05 12:01:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dafd8d9-1505-4071-a812-a61249d5495c tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-ad528fc7-1a41-4d73-89ed-e7ae4b47aac0-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-b75bc742-fe62-407f-ab45-a1f8e8ea364a" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-b75bc742-fe62-407f-ab45-a1f8e8ea364a" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:12 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[052fa015-01e5-4f7d-b993-755d912484ad]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:13 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a Nov 05 12:01:13 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Creating offline snapshot 193c90ad-d32b-4c77-98ce-c655d1bc4ca5 of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:01:13 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff335c-2613-4fb2-bff5-f2a5fa3dc8f2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:13 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a Nov 05 12:01:13 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:13 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:01:13 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:13 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b75bc742-fe62-407f-ab45-a1f8e8ea364a" returned: 0 in 0.320s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-b75bc742-fe62-407f-ab45-a1f8e8ea364a" released by "delete_volume" :: held 0.974s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['4bcbadea-f54e-41ee-821e-641db3d8f24f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:13 devstack cinder-volume[86942]: WARNING cinder.db.api [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2076465681'] Nov 05 12:01:13 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['02f53f0e-111e-4db2-b959-5d4f5595fce6', 'd6457049-304f-442a-91d1-afdd685bde85', 'e8765ce7-e634-4863-911d-f845b22350d5', '1dd050ef-529b-4652-b9d0-9a65fd03621f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:14 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.542s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:14 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 1G Nov 05 12:01:14 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:14 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:14 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:14 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.391s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bd2fe775-8bc7-4b5f-9376-a615af37088c tempest-GroupSnapshotsTest-2112745905 None] Delete group completed successfully. Nov 05 12:01:14 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 1G" returned: 0 in 0.713s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:14 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 Nov 05 12:01:14 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:15 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5" returned: 0 in 0.406s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:15 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 is being set with open permissions: ugo+rw Nov 05 12:01:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:15 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 Nov 05 12:01:15 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:15 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5" returned: 0 in 0.396s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d6c82338-f195-4ebd-b3ab-08e2cdf4b7a3 tempest-SnapshotsActionsTest-2058063200 None] Create snapshot completed successfully Nov 05 12:01:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2b55cb30-3fd3-4c40-b19d-469e330844bb tempest-GroupSnapshotsTest-2112745905 None] Group tempest-GroupSnapshotsTest-Group-1938351887: creating Nov 05 12:01:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2b55cb30-3fd3-4c40-b19d-469e330844bb tempest-GroupSnapshotsTest-2112745905 None] Group tempest-GroupSnapshotsTest-Group-1938351887: created successfully Nov 05 12:01:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2b55cb30-3fd3-4c40-b19d-469e330844bb tempest-GroupSnapshotsTest-2112745905 None] Create group completed successfully. Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Flow 'volume_create_manager' (1e267387-7855-49ec-9d3d-3dc7889357fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e14012-1e01-403a-8ade-566885cd8aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e14012-1e01-403a-8ade-566885cd8aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1504624617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b75e4a3-f449-4257-b752-1ba067973198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57eb6bcfe9a49f489d0b19b0b877bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:16Z,use_quota=True,user_id='d0fcbeb41ce843c39e72240e140962c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd13c9b7-a164-48be-bf9f-ee30de5f1ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd13c9b7-a164-48be-bf9f-ee30de5f1ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a14071-9a03-4de8-bea7-3f95d034d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a14071-9a03-4de8-bea7-3f95d034d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b75e4a3-f449-4257-b752-1ba067973198', 'volume_name': 'volume-2b75e4a3-f449-4257-b752-1ba067973198', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c11368f-c7d3-4809-a72b-f872e88658aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c11368f-c7d3-4809-a72b-f872e88658aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ad7321-c2da-4703-94e6-2e0572d7f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:16 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Volume 2b75e4a3-f449-4257-b752-1ba067973198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b75e4a3-f449-4257-b752-1ba067973198', 'volume_size': 1} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1504624617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b75e4a3-f449-4257-b752-1ba067973198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57eb6bcfe9a49f489d0b19b0b877bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:16Z,use_quota=True,user_id='d0fcbeb41ce843c39e72240e140962c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Creating volume 2b75e4a3-f449-4257-b752-1ba067973198 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:16 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:16 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 1073741824 Nov 05 12:01:16 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-193c90ad-d32b-4c77-98ce-c655d1bc4ca5-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-193c90ad-d32b-4c77-98ce-c655d1bc4ca5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Acquiring lock "cinder-quobyte-193c90ad-d32b-4c77-98ce-c655d1bc4ca5" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-193c90ad-d32b-4c77-98ce-c655d1bc4ca5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Deleting offline snapshot 193c90ad-d32b-4c77-98ce-c655d1bc4ca5 of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] snapshot_file for this snap is: volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9819b8f4-30fc-46f7-a446-bace6df2f0db]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:17 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 Nov 05 12:01:17 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:17 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 1073741824" returned: 0 in 0.816s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:17 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 Nov 05 12:01:17 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:17 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5" returned: 0 in 0.642s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[84089433-c952-4478-8dd1-1640c87616de]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:17 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:01:17 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:17 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ad7321-c2da-4703-94e6-2e0572d7f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b75e4a3-f449-4257-b752-1ba067973198', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea76d3a-fac0-4311-9775-af157ff22b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:17 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Volume volume-2b75e4a3-f449-4257-b752-1ba067973198 (2b75e4a3-f449-4257-b752-1ba067973198): created successfully Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea76d3a-fac0-4311-9775-af157ff22b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Flow 'volume_create_manager' (1e267387-7855-49ec-9d3d-3dc7889357fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-35f5a7f4-62e7-4f76-b834-945aff03d221 tempest-VolumesListAdminTestJSON-1370259286 None] Created volume successfully. Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (b4285cb7-9fd4-485a-9f0b-21a7cbe34bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e103105-1713-4d13-b1d7-3d3fa6f31c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e103105-1713-4d13-b1d7-3d3fa6f31c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774377616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9dba5b0-f090-4849-b245-1c385feee759,host='devstack@QuobyteHD#QuobyteHD',id=70ff3a6c-3dc5-4ec0-8cdc-2a5993204524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:18Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a44b30e-8990-49a7-a1b3-e716400d6908),volume_type_id=5a44b30e-8990-49a7-a1b3-e716400d6908)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:18 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2297f355-4e07-4dee-b70e-6937740aabf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2297f355-4e07-4dee-b70e-6937740aabf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf5ca63-424c-4872-a8e7-020b503dcbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf5ca63-424c-4872-a8e7-020b503dcbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ff3a6c-3dc5-4ec0-8cdc-2a5993204524', 'volume_name': 'volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51380732-3522-48df-be51-619414cc0d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51380732-3522-48df-be51-619414cc0d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cdfd23-35a7-4bcd-8320-4b62defd45be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:18 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Volume 70ff3a6c-3dc5-4ec0-8cdc-2a5993204524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524', 'volume_size': 1} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9dba5b0-f090-4849-b245-1c385feee759,created_at=2026-11-05T11:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774377616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9dba5b0-f090-4849-b245-1c385feee759,host='devstack@QuobyteHD#QuobyteHD',id=70ff3a6c-3dc5-4ec0-8cdc-2a5993204524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:18Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a44b30e-8990-49a7-a1b3-e716400d6908),volume_type_id=5a44b30e-8990-49a7-a1b3-e716400d6908)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Creating volume 70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:18 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.675s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:18 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 1073741824 Nov 05 12:01:18 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:18 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 Nov 05 12:01:18 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:19 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5" returned: 0 in 0.772s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:19 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5 Nov 05 12:01:19 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:19 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 1073741824" returned: 0 in 0.931s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:19 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 Nov 05 12:01:19 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:19 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.193c90ad-d32b-4c77-98ce-c655d1bc4ca5" returned: 0 in 0.602s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-193c90ad-d32b-4c77-98ce-c655d1bc4ca5" released by "_delete_snapshot" :: held 2.896s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" released by "delete_snapshot" :: held 2.939s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Flow 'volume_create_manager' (0a522c23-c9f9-4eef-bf55-e9804470928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfe34f8-4c66-491f-ac08-3ab0e218f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:19 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfe34f8-4c66-491f-ac08-3ab0e218f950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2096032130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78909ac2-6a93-4bed-9eba-a5d3ce22507e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57eb6bcfe9a49f489d0b19b0b877bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:20Z,use_quota=True,user_id='d0fcbeb41ce843c39e72240e140962c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a99dd9b-5f70-4e76-92c0-ce8a255e2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a99dd9b-5f70-4e76-92c0-ce8a255e2b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb4dcb1-7b61-4144-9657-260f8f49b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb4dcb1-7b61-4144-9657-260f8f49b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78909ac2-6a93-4bed-9eba-a5d3ce22507e', 'volume_name': 'volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbbe6a3-1726-4a50-9576-3cf31ffaf5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbbe6a3-1726-4a50-9576-3cf31ffaf5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d253d2-84f6-4573-830c-4f93585f8756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:19 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Volume 78909ac2-6a93-4bed-9eba-a5d3ce22507e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e', 'volume_size': 1} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" returned: 0 in 0.643s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2096032130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78909ac2-6a93-4bed-9eba-a5d3ce22507e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57eb6bcfe9a49f489d0b19b0b877bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:20Z,use_quota=True,user_id='d0fcbeb41ce843c39e72240e140962c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Creating volume 78909ac2-6a93-4bed-9eba-a5d3ce22507e {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:19 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:19 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e 1073741824 Nov 05 12:01:19 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cdfd23-35a7-4bcd-8320-4b62defd45be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd78b2fe-008e-4e78-9734-0002b857c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:20 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Volume volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 (70ff3a6c-3dc5-4ec0-8cdc-2a5993204524): created successfully Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd78b2fe-008e-4e78-9734-0002b857c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (b4285cb7-9fd4-485a-9f0b-21a7cbe34bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-cbcc20fc-2881-4196-9eaa-36cc31f4eb9e tempest-GroupSnapshotsTest-2112745905 None] Created volume successfully. Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Created reservations ['35b34add-cb88-4228-8042-d649af80e680', '93938867-9373-436e-af19-d6a30487b63e', 'a612aa3e-183b-4774-8759-739af5bf206b', '2788cb1b-9c79-41b1-8374-38b1930f75a8'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Delete snapshot completed successfully. Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f797b17b-6c37-45fe-a75b-0f088eb8f20a tempest-SnapshotsActionsTest-1975340093 None] Lock "cinder-193c90ad-d32b-4c77-98ce-c655d1bc4ca5-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:20 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e 1073741824" returned: 0 in 0.636s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-3cf31285-6fa9-48cb-b387-f9a58d6b9616 tempest-ServerActionsTestOtherA-1114459445 None] Terminate volume connection completed successfully. Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-3cf31285-6fa9-48cb-b387-f9a58d6b9616 tempest-ServerActionsTestOtherA-1114459445 None] Deleting attachment 4417b295-d082-4e8a-aa30-7c38cbb22ad0. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:01:20 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e Nov 05 12:01:20 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "cinder-c139aefd-4d0e-4ad6-9deb-9597a7526b74-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-c139aefd-4d0e-4ad6-9deb-9597a7526b74-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "cinder-quobyte-c139aefd-4d0e-4ad6-9deb-9597a7526b74" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-quobyte-c139aefd-4d0e-4ad6-9deb-9597a7526b74" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86d0a37-24b1-4387-b358-1b04e57146ab]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:20 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e" returned: 0 in 0.380s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d253d2-84f6-4573-830c-4f93585f8756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5059bcbd-9815-447a-8007-f56e2e5e46cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Volume volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e (78909ac2-6a93-4bed-9eba-a5d3ce22507e): created successfully Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5059bcbd-9815-447a-8007-f56e2e5e46cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Flow 'volume_create_manager' (0a522c23-c9f9-4eef-bf55-e9804470928e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:21 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a8b7fffe-f5c3-4218-92d4-ed88e7b6c23f tempest-VolumesListAdminTestJSON-1370259286 None] Created volume successfully. Nov 05 12:01:21 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 Nov 05 12:01:21 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:21 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (7a67380d-c4f1-4cea-badd-37c2a75df53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bce7c9-0114-45b2-b303-02c513b96575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74" returned: 0 in 0.746s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bce7c9-0114-45b2-b303-02c513b96575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-407240904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9dba5b0-f090-4849-b245-1c385feee759,host='devstack@QuobyteHD#QuobyteHD',id=8494bfba-200f-41a7-bb27-945fc7cc25b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:22Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a44b30e-8990-49a7-a1b3-e716400d6908),volume_type_id=5a44b30e-8990-49a7-a1b3-e716400d6908)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:21 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74 Nov 05 12:01:21 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61987435-c50f-4c5e-b8ba-dc7d7ae79272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61987435-c50f-4c5e-b8ba-dc7d7ae79272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543afc07-bb53-46a5-a28a-3c4ea2835b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543afc07-bb53-46a5-a28a-3c4ea2835b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8494bfba-200f-41a7-bb27-945fc7cc25b1', 'volume_name': 'volume-8494bfba-200f-41a7-bb27-945fc7cc25b1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484898f8-6be6-455f-b2b4-a740492b4559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484898f8-6be6-455f-b2b4-a740492b4559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da3242f-a4eb-415f-b9fb-8de91bd849ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Volume 8494bfba-200f-41a7-bb27-945fc7cc25b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8494bfba-200f-41a7-bb27-945fc7cc25b1', 'volume_size': 1} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9dba5b0-f090-4849-b245-1c385feee759,created_at=2026-11-05T11:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-407240904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9dba5b0-f090-4849-b245-1c385feee759,host='devstack@QuobyteHD#QuobyteHD',id=8494bfba-200f-41a7-bb27-945fc7cc25b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:22Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a44b30e-8990-49a7-a1b3-e716400d6908),volume_type_id=5a44b30e-8990-49a7-a1b3-e716400d6908)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Creating volume 8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:21 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:21 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 1073741824 Nov 05 12:01:21 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:22 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c139aefd-4d0e-4ad6-9deb-9597a7526b74" returned: 0 in 0.380s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-quobyte-c139aefd-4d0e-4ad6-9deb-9597a7526b74" released by "delete_volume" :: held 1.200s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "cinder-5acc93a4-ab8b-4926-a778-6c13685bf65b-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-5acc93a4-ab8b-4926-a778-6c13685bf65b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "cinder-quobyte-5acc93a4-ab8b-4926-a778-6c13685bf65b" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.quota [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Created reservations ['081ee651-3a55-440e-b17a-ffed9f2ed279', 'f657e2a1-f921-4ec6-adb8-991afaae058e', '0962e237-54a4-422c-84a9-b0bf59d4ba71', '2cb1b0b0-b377-4ab6-b144-cae78f5e7b6d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-quobyte-5acc93a4-ab8b-4926-a778-6c13685bf65b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Deleting offline snapshot 5acc93a4-ab8b-4926-a778-6c13685bf65b of volume 8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] snapshot_file for this snap is: volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3af2f0-7d41-4dec-90da-e1eaf2c8bf96]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:22 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:22 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:22 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:01:22 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:22 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 1073741824" returned: 0 in 0.754s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:22 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 Nov 05 12:01:22 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Flow 'volume_create_manager' (11cd4326-eb0e-4c13-afee-de570247d03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c56161-aa19-4127-b6ce-ecc2d1ab8ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c56161-aa19-4127-b6ce-ecc2d1ab8ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2630879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efca486c-e3f6-4257-830d-08443f2f1b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57eb6bcfe9a49f489d0b19b0b877bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:23Z,use_quota=True,user_id='d0fcbeb41ce843c39e72240e140962c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6395f63b-c93a-445e-9411-c2b2548cf662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6395f63b-c93a-445e-9411-c2b2548cf662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919aa327-0d01-43c7-b23b-860dc4dff7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919aa327-0d01-43c7-b23b-860dc4dff7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efca486c-e3f6-4257-830d-08443f2f1b13', 'volume_name': 'volume-efca486c-e3f6-4257-830d-08443f2f1b13', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91cc90b-4300-4275-a18c-113c5cb06ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91cc90b-4300-4275-a18c-113c5cb06ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa3cb85-1358-4c4c-b11b-93dfb7c2716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:22 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Volume efca486c-e3f6-4257-830d-08443f2f1b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efca486c-e3f6-4257-830d-08443f2f1b13', 'volume_size': 1} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "cinder-2a8f197d-6713-49d3-bbbd-40d94c75c0ac-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-2a8f197d-6713-49d3-bbbd-40d94c75c0ac-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:22 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.574s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:22 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.517s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG cinder.manager [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Deleted volume successfully. Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1061b8-f33a-49fe-8f97-c1326cff20f7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:22 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "cinder-quobyte-2a8f197d-6713-49d3-bbbd-40d94c75c0ac" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1" returned: 0 in 0.399s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.257s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2630879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efca486c-e3f6-4257-830d-08443f2f1b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57eb6bcfe9a49f489d0b19b0b877bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:23Z,use_quota=True,user_id='d0fcbeb41ce843c39e72240e140962c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Creating volume efca486c-e3f6-4257-830d-08443f2f1b13 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:23 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-quobyte-2a8f197d-6713-49d3-bbbd-40d94c75c0ac" acquired by "delete_volume" :: waited 0.070s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:23 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 1073741824 Nov 05 12:01:23 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-77557fb2-f808-48c6-be13-77154f3c1fc0 req-46ac9d82-868a-440b-a4d6-6fb7f63a2e4c tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-c139aefd-4d0e-4ad6-9deb-9597a7526b74-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da3242f-a4eb-415f-b9fb-8de91bd849ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8494bfba-200f-41a7-bb27-945fc7cc25b1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c589cd49-ff4d-41f6-be77-affbf75004e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0707a5-697f-45a4-9621-96bb3fd5baf8]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:23 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc Nov 05 12:01:23 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:23 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Volume volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 (8494bfba-200f-41a7-bb27-945fc7cc25b1): created successfully Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c589cd49-ff4d-41f6-be77-affbf75004e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (7a67380d-c4f1-4cea-badd-37c2a75df53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:23 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fff620cc-c970-4177-94d7-9c2af626c11b tempest-GroupSnapshotsTest-2112745905 None] Created volume successfully. Nov 05 12:01:23 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac Nov 05 12:01:23 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:23 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc" returned: 0 in 0.438s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:23 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:01:23 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:23 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac" returned: 0 in 0.496s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:23 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 1073741824" returned: 0 in 0.591s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:23 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac Nov 05 12:01:23 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:23 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 Nov 05 12:01:23 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:23 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.415s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:23 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b Nov 05 12:01:23 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:23 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2a8f197d-6713-49d3-bbbd-40d94c75c0ac" returned: 0 in 0.335s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-quobyte-2a8f197d-6713-49d3-bbbd-40d94c75c0ac" released by "delete_volume" :: held 0.896s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:24 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13" returned: 0 in 0.332s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa3cb85-1358-4c4c-b11b-93dfb7c2716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efca486c-e3f6-4257-830d-08443f2f1b13', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998f40f4-572e-4116-9a50-35b6c0c155bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:24 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Volume volume-efca486c-e3f6-4257-830d-08443f2f1b13 (efca486c-e3f6-4257-830d-08443f2f1b13): created successfully Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998f40f4-572e-4116-9a50-35b6c0c155bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Flow 'volume_create_manager' (11cd4326-eb0e-4c13-afee-de570247d03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Created reservations ['83c5ebb3-3929-4f98-bf8b-b46598a3fa87', 'cc8b7e57-cb65-42f4-90f9-fca5abdf1968', '1a8f78f5-14f4-41b1-afb4-290f9a9d1b95', '6651c9e5-f32e-44fb-932b-08ffb7704d34'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9a1d73b4-3226-4e9a-93f8-27de3963c179 tempest-VolumesListAdminTestJSON-1370259286 None] Created volume successfully. Nov 05 12:01:24 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc.5acc93a4-ab8b-4926-a778-6c13685bf65b" returned: 0 in 0.339s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:24 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:24 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-quobyte-5acc93a4-ab8b-4926-a778-6c13685bf65b" released by "_delete_snapshot" :: held 1.988s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" released by "delete_snapshot" :: held 2.034s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Created reservations ['f74e840c-9163-4187-96b5-dac51d900f61', '12a09ef4-f4aa-4bef-ad67-5b0317500c04', '813a76a7-6ef4-404a-af04-98b5aa7451b2', '521ad360-2e47-4d41-b977-d0396ee95bc5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d2145701-901b-429b-83da-924168735b8e tempest-GroupSnapshotsTest-2112745905 None] Update group completed successfully. Nov 05 12:01:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Delete snapshot completed successfully. Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd7c46c4-58ef-445d-82af-1b8f0aaa74c9 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-5acc93a4-ab8b-4926-a778-6c13685bf65b-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:24 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.302s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Deleted volume successfully. Nov 05 12:01:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-365c59d9-bbb3-4ba2-88f3-3664dc6857ae tempest-ServerActionsTestOtherA-1114459445 None] Lock "cinder-2a8f197d-6713-49d3-bbbd-40d94c75c0ac-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "cinder-8128a681-a32f-42a8-99cf-f9dcc594b4cc-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-8128a681-a32f-42a8-99cf-f9dcc594b4cc-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Flow 'volume_create_manager' (89d76c7e-3692-4bab-b6ae-4cf1b52e5eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8facb1a3-cf0d-4643-a2e9-1a0bacb5ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8facb1a3-cf0d-4643-a2e9-1a0bacb5ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d4791d-d123-414c-9d9e-046dd58238c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0018b5d1c62c40f89c267d9c99b636e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:26Z,use_quota=True,user_id='8a8ac6bdb54f45f7b497258e9b360848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfde349-474d-4ab7-9439-be8c1fcc3c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfde349-474d-4ab7-9439-be8c1fcc3c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fbc20b-7f16-4cb0-871b-856156ddd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fbc20b-7f16-4cb0-871b-856156ddd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d4791d-d123-414c-9d9e-046dd58238c1', 'volume_name': 'volume-23d4791d-d123-414c-9d9e-046dd58238c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee74a885-f5d4-4c52-8313-a0adfec58324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee74a885-f5d4-4c52-8313-a0adfec58324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e92e3b7-950f-42e2-9767-986d63a8154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:25 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Volume 23d4791d-d123-414c-9d9e-046dd58238c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d4791d-d123-414c-9d9e-046dd58238c1', 'volume_size': 1} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d4791d-d123-414c-9d9e-046dd58238c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0018b5d1c62c40f89c267d9c99b636e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:26Z,use_quota=True,user_id='8a8ac6bdb54f45f7b497258e9b360848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Creating volume 23d4791d-d123-414c-9d9e-046dd58238c1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:25 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" acquired by "delete_volume" :: waited 0.257s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:26 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 1073741824 Nov 05 12:01:26 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a463c8b6-0ccc-43a0-afcc-a0bced26a5fa tempest-GroupSnapshotsTest-2112745905 None] Update group completed successfully. Nov 05 12:01:26 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd9ba7f-e5cd-41fa-8cf0-aa35c8fd77a4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:26 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc Nov 05 12:01:26 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:26 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc" returned: 0 in 0.640s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:26 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 1073741824" returned: 0 in 0.810s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:26 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc Nov 05 12:01:26 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:26 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 Nov 05 12:01:26 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8d0e0711-9fba-4d62-aaeb-9085873cb071 tempest-GroupSnapshotsTest-2112745905 None] Update group completed successfully. Nov 05 12:01:27 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8128a681-a32f-42a8-99cf-f9dcc594b4cc" returned: 0 in 0.423s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-quobyte-8128a681-a32f-42a8-99cf-f9dcc594b4cc" released by "delete_volume" :: held 1.222s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Created reservations ['46fe1dce-ba43-405a-99fc-c9e7c997bc02', '43b2f043-3aea-4ab5-9d2d-298b6d681388', '529d52fa-7abe-490c-8178-2fe689ace350', 'b16cf656-c416-4213-9f8d-7bb465df5f6e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:27 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1" returned: 0 in 0.532s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e92e3b7-950f-42e2-9767-986d63a8154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d4791d-d123-414c-9d9e-046dd58238c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e82c31-988a-4c9d-97f7-c05a31fddf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:27 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Volume volume-23d4791d-d123-414c-9d9e-046dd58238c1 (23d4791d-d123-414c-9d9e-046dd58238c1): created successfully Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e82c31-988a-4c9d-97f7-c05a31fddf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Flow 'volume_create_manager' (89d76c7e-3692-4bab-b6ae-4cf1b52e5eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d5459916-db18-49c1-9440-de7130e828ee tempest-VolumesListAdminTestJSON-1331338560 None] Created volume successfully. Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:27 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:27 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Acquiring lock "cinder-23d4791d-d123-414c-9d9e-046dd58238c1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Lock "cinder-23d4791d-d123-414c-9d9e-046dd58238c1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:27 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.388s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Deleted volume successfully. Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Acquiring lock "cinder-quobyte-23d4791d-d123-414c-9d9e-046dd58238c1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2ab8ee81-83e2-4b75-92ba-e623bd11a030 tempest-SnapshotsActionsTest-2058063200 None] Lock "cinder-8128a681-a32f-42a8-99cf-f9dcc594b4cc-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Lock "cinder-quobyte-23d4791d-d123-414c-9d9e-046dd58238c1" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[891df3e4-dc06-425c-ad87-44367c3a9149]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "cinder-efca486c-e3f6-4257-830d-08443f2f1b13-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-efca486c-e3f6-4257-830d-08443f2f1b13-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "cinder-quobyte-efca486c-e3f6-4257-830d-08443f2f1b13" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-quobyte-efca486c-e3f6-4257-830d-08443f2f1b13" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:28 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 Nov 05 12:01:28 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[93326deb-23ee-46c9-ae12-232b69e0f10d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:28 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c10ec71e-0c97-4ffa-9ceb-d0ff5d2faa39 tempest-GroupSnapshotsTest-2112745905 None] Update group completed successfully. Nov 05 12:01:28 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 Nov 05 12:01:28 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:28 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1" returned: 0 in 0.703s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:28 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1 Nov 05 12:01:28 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:28 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13" returned: 0 in 0.664s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:29 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13 Nov 05 12:01:29 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:29 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-23d4791d-d123-414c-9d9e-046dd58238c1" returned: 0 in 0.360s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Lock "cinder-quobyte-23d4791d-d123-414c-9d9e-046dd58238c1" released by "delete_volume" :: held 1.146s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Created reservations ['bbfc10b2-8acf-4b26-8412-a9bc55e1c537', '8b0ce8f1-3676-41ac-9940-09a4d4cb9d57', 'c9223c49-1e6e-4c3f-b71e-446231336888', '7700d0c0-23c1-45f2-a70d-43e60e80d4f7'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:29 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:29 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:29 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-efca486c-e3f6-4257-830d-08443f2f1b13" returned: 0 in 0.502s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-quobyte-efca486c-e3f6-4257-830d-08443f2f1b13" released by "delete_volume" :: held 1.242s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Created reservations ['4e11a1cb-57a5-486f-87f2-b8df9443374a', 'c0fffdbd-d4ce-41e4-b24b-bfdec8c42ea0', '916c5301-ff89-484d-8f2d-c6e05830b52b', '115c65fa-0347-4173-82e2-857c75124839'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:29 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:29 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:29 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.547s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:29 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Deleted volume successfully. Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0a0f0be7-19a4-4d74-ac0e-fded2373462f tempest-VolumesListAdminTestJSON-1331338560 None] Lock "cinder-23d4791d-d123-414c-9d9e-046dd58238c1-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:30 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Deleted volume successfully. Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-07aaf005-6a57-475d-a87a-ff91a3557822 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-efca486c-e3f6-4257-830d-08443f2f1b13-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] GroupSnapshot c8ee1c38-e0d9-45b5-8a8e-ca3af5181eb0: creating. Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Group snapshot c8ee1c38-e0d9-45b5-8a8e-ca3af5181eb0: creating. {{(pid=86942) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Creating offline snapshot 8b52508e-e53a-4832-a9fd-7f851a315ca6 of volume 8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b81137c-2bdc-4cf5-9adc-a716ae046643]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "cinder-78909ac2-6a93-4bed-9eba-a5d3ce22507e-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-78909ac2-6a93-4bed-9eba-a5d3ce22507e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:30 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 Nov 05 12:01:30 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "cinder-quobyte-78909ac2-6a93-4bed-9eba-a5d3ce22507e" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-quobyte-78909ac2-6a93-4bed-9eba-a5d3ce22507e" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0bb2e3-c396-4960-9442-4bd814597dc7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:30 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e Nov 05 12:01:30 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:31 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1" returned: 0 in 0.598s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:31 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 1G Nov 05 12:01:31 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:31 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e" returned: 0 in 0.652s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:31 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e Nov 05 12:01:31 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:31 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 1G" returned: 0 in 0.739s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:31 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 Nov 05 12:01:31 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:31 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-78909ac2-6a93-4bed-9eba-a5d3ce22507e" returned: 0 in 0.408s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-quobyte-78909ac2-6a93-4bed-9eba-a5d3ce22507e" released by "delete_volume" :: held 1.134s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Created reservations ['cac8d8c3-e8d1-474a-97bb-616f0904d582', '80461e12-acf8-4669-8f6b-523449cd1c5e', '2a6d5a6c-71c8-47d9-8441-d0284228ad7a', 'dd1f8bc6-dbe2-4df5-aace-d40ba91e765c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:32 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:32 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:32 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6" returned: 0 in 0.538s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:32 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:32 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 Nov 05 12:01:32 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:32 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.322s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Deleted volume successfully. Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8b957651-cda1-4474-a864-5783317ca7ef tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-78909ac2-6a93-4bed-9eba-a5d3ce22507e-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:32 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6" returned: 0 in 0.406s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:32 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.info Nov 05 12:01:32 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "cinder-2b75e4a3-f449-4257-b752-1ba067973198-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-2b75e4a3-f449-4257-b752-1ba067973198-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "cinder-quobyte-2b75e4a3-f449-4257-b752-1ba067973198" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-quobyte-2b75e4a3-f449-4257-b752-1ba067973198" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:33 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.info" returned: 0 in 0.481s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:33 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86866e-e82e-4a73-9d02-d7fa3dbfbcfa]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:33 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.info Nov 05 12:01:33 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:33 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 Nov 05 12:01:33 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:33 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.info" returned: 0 in 0.414s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.312s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Creating offline snapshot b98f81cd-ce74-417f-9656-e61acaa8d414 of volume 70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2775da33-ee23-4bd2-a2f8-b68388e2a389]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:33 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198" returned: 0 in 0.547s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:33 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198 Nov 05 12:01:33 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:33 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 Nov 05 12:01:33 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:34 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b75e4a3-f449-4257-b752-1ba067973198" returned: 0 in 0.364s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-quobyte-2b75e4a3-f449-4257-b752-1ba067973198" released by "delete_volume" :: held 0.978s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:34 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" returned: 0 in 0.528s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Created reservations ['b240d9fe-776f-4f67-b1e3-650f862f184f', '643d877e-e6fa-4005-9141-fe2651696246', '32321922-a8a4-4e83-a32c-c768e5b67420', 'fe7ee201-bb93-4502-a4ce-b58eabafc014'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:34 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 1G Nov 05 12:01:34 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:34 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:34 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:34 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.390s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Deleted volume successfully. Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0a652d-3f31-4eb7-ad88-71ff3bef72f8 tempest-VolumesListAdminTestJSON-1370259286 None] Lock "cinder-2b75e4a3-f449-4257-b752-1ba067973198-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:34 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 1G" returned: 0 in 0.635s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:34 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 Nov 05 12:01:34 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:35 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414" returned: 0 in 0.376s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:35 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:01:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:35 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 Nov 05 12:01:35 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:35 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414" returned: 0 in 0.470s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:35 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.info Nov 05 12:01:35 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:36 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.info" returned: 0 in 0.462s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:36 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:01:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:36 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.info Nov 05 12:01:36 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:36 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.info" returned: 0 in 0.341s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b0fbd4e6-e4c0-4b29-adaa-af338d21f3e6 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot c8ee1c38-e0d9-45b5-8a8e-ca3af5181eb0: created successfully Nov 05 12:01:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] group_snapshot c8ee1c38-e0d9-45b5-8a8e-ca3af5181eb0: deleting Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] group_snapshot c8ee1c38-e0d9-45b5-8a8e-ca3af5181eb0: deleting {{(pid=86942) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-8494bfba-200f-41a7-bb27-945fc7cc25b1" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-8494bfba-200f-41a7-bb27-945fc7cc25b1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-8b52508e-e53a-4832-a9fd-7f851a315ca6" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-8b52508e-e53a-4832-a9fd-7f851a315ca6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Deleting offline snapshot 8b52508e-e53a-4832-a9fd-7f851a315ca6 of volume 8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] snapshot_file for this snap is: volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ca6c0-a6e8-4030-acde-cff226b5d394]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:38 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 Nov 05 12:01:38 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Flow 'volume_create_manager' (d481aac2-4d28-47dc-a146-23bd251fac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7ba423-b223-418d-829d-558d86f8d350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7ba423-b223-418d-829d-558d86f8d350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-505707394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b26bccd-0754-4ac6-8b01-936b680b2efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b0eebb88584121b5ed88dfb48e5f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:39Z,use_quota=True,user_id='7e9bfa94d2ad4d39ac0ddceb1616a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34968dea-7581-46b7-a9f6-d24cde880d40),volume_type_id=34968dea-7581-46b7-a9f6-d24cde880d40)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e4e214-7a62-41a9-8e3c-c1dbd6cacf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e4e214-7a62-41a9-8e3c-c1dbd6cacf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df3246-6105-424c-8214-76c1bb3a8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df3246-6105-424c-8214-76c1bb3a8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b26bccd-0754-4ac6-8b01-936b680b2efb', 'volume_name': 'volume-8b26bccd-0754-4ac6-8b01-936b680b2efb', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4247b225-5097-4244-90e8-edda82758887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4247b225-5097-4244-90e8-edda82758887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f6345-e6ec-481a-9bcd-d7a08d4b1d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:38 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Volume 8b26bccd-0754-4ac6-8b01-936b680b2efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b26bccd-0754-4ac6-8b01-936b680b2efb', 'volume_size': 1} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-505707394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b26bccd-0754-4ac6-8b01-936b680b2efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b0eebb88584121b5ed88dfb48e5f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:39Z,use_quota=True,user_id='7e9bfa94d2ad4d39ac0ddceb1616a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34968dea-7581-46b7-a9f6-d24cde880d40),volume_type_id=34968dea-7581-46b7-a9f6-d24cde880d40)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Creating volume 8b26bccd-0754-4ac6-8b01-936b680b2efb {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:38 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:38 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb 1073741824 Nov 05 12:01:38 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:38 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6" returned: 0 in 0.692s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8494bfba-200f-41a7-bb27-945fc7cc25b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2334c36-c434-4dbb-9dc6-f62a0dd2703f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:39 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 Nov 05 12:01:39 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:39 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:39 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1" returned: 0 in 0.683s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb 1073741824" returned: 0 in 0.794s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:39 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 Nov 05 12:01:39 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:39 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb Nov 05 12:01:39 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:40 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f6345-e6ec-481a-9bcd-d7a08d4b1d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b26bccd-0754-4ac6-8b01-936b680b2efb', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22548064-f27e-4c83-b89c-c2ed5018164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:40 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Volume volume-8b26bccd-0754-4ac6-8b01-936b680b2efb (8b26bccd-0754-4ac6-8b01-936b680b2efb): created successfully Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22548064-f27e-4c83-b89c-c2ed5018164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Flow 'volume_create_manager' (d481aac2-4d28-47dc-a146-23bd251fac7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:40 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6" returned: 0 in 0.546s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:40 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-33af2a00-0d2f-449a-b366-47769d552f89 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Created volume successfully. Nov 05 12:01:40 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6 Nov 05 12:01:40 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:40 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1.8b52508e-e53a-4832-a9fd-7f851a315ca6" returned: 0 in 0.324s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-8b52508e-e53a-4832-a9fd-7f851a315ca6" released by "_delete_snapshot" :: held 2.410s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-8494bfba-200f-41a7-bb27-945fc7cc25b1" released by "delete_snapshot" :: held 2.454s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-b98f81cd-ce74-417f-9656-e61acaa8d414" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-b98f81cd-ce74-417f-9656-e61acaa8d414" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Deleting offline snapshot b98f81cd-ce74-417f-9656-e61acaa8d414 of volume 70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] snapshot_file for this snap is: volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[333e350d-fe4e-48bb-8e9f-4c91aec080b1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:40 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 Nov 05 12:01:40 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:41 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414" returned: 0 in 0.635s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1ebef-a070-49fc-af7d-b321f3a418b9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:41 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 Nov 05 12:01:41 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:41 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:41 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:41 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" returned: 0 in 0.567s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:41 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.377s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:42 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d8728aa8-f962-43f5-a331-60809ddd7de1 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Retype volume completed successfully. Nov 05 12:01:42 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 Nov 05 12:01:42 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:42 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414" returned: 0 in 0.495s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:42 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414 Nov 05 12:01:42 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:42 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524.b98f81cd-ce74-417f-9656-e61acaa8d414" returned: 0 in 0.351s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-b98f81cd-ce74-417f-9656-e61acaa8d414" released by "_delete_snapshot" :: held 2.255s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" released by "delete_snapshot" :: held 2.290s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:43 devstack cinder-volume[86942]: WARNING cinder.quota [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-953319802 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-953319802, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:43 devstack cinder-volume[86942]: WARNING cinder.quota [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-953319802 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-953319802, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['b903a235-8013-49ef-9664-b39d37e6556f', '385dfbb7-931b-4e57-ba91-c30279b430dd', '67a0d96e-bdf4-4fa6-9632-81dd219bcd45', 'fe7d02e9-a62c-45cb-871c-b4d5bf1ff49b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=154,cinder:DELETE=11,cinder:UPDATE=152,cinder:INSERT=42 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=153,cinder:UPDATE=161,cinder:INSERT=35,cinder:DELETE=7 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Acquiring lock "cinder-8b26bccd-0754-4ac6-8b01-936b680b2efb-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "cinder-8b26bccd-0754-4ac6-8b01-936b680b2efb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['71feb370-9b34-4c80-b317-dca1a8304a1e', '4f3817a2-ed9d-4abc-b861-403943125a42', '7dc33cd1-7307-4369-8c8f-f8c06b80e98d', '5a0b2bdb-4b51-479f-aa23-a5a058ccaae4'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Acquiring lock "cinder-quobyte-8b26bccd-0754-4ac6-8b01-936b680b2efb" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "cinder-quobyte-8b26bccd-0754-4ac6-8b01-936b680b2efb" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c83702-3c10-4f88-a67a-2cc3393a2e01]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5bcc429b-e0e9-4f29-8739-0f586636ef1f tempest-GroupSnapshotsTest-2112745905 None] group_snapshot c8ee1c38-e0d9-45b5-8a8e-ca3af5181eb0: deleted successfully Nov 05 12:01:43 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb Nov 05 12:01:43 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Flow 'volume_create_manager' (f181ad43-8718-4726-bd31-d68da1929a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e838202-3700-4a37-8c87-d0eb2159a4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e838202-3700-4a37-8c87-d0eb2159a4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-51057773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2e002c-52cb-45ae-8ea8-8a2b0c83149d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e3b55a750e4cf8b57b5743c143c1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:44Z,use_quota=True,user_id='0963ed8a73a143bfa50221a4f3e03afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9e99d-f172-43f9-88bd-59ae052298e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9e99d-f172-43f9-88bd-59ae052298e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ccd993-d442-4678-ba58-2a8011b951af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:01:43 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb" returned: 0 in 0.465s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:43 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb Nov 05 12:01:43 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ccd993-d442-4678-ba58-2a8011b951af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f2e002c-52cb-45ae-8ea8-8a2b0c83149d', 'volume_name': 'volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374be639-634b-4127-be9e-cff96f119f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374be639-634b-4127-be9e-cff96f119f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4e855d-ab6e-4cf8-87ae-e69a898d87e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:44 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Volume 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Trying to clone 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:01:44 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b26bccd-0754-4ac6-8b01-936b680b2efb" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "cinder-quobyte-8b26bccd-0754-4ac6-8b01-936b680b2efb" released by "delete_volume" :: held 1.014s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:01:44 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Image download 20.69 MB at 20.69 MB/s Nov 05 12:01:44 devstack cinder-volume[86942]: WARNING cinder.quota [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:44 devstack cinder-volume[86942]: WARNING cinder.quota [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e95292-548f-4634-a808-ca7e2bbb9266]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Created reservations ['47f1438b-c73c-4735-8e75-6d6b8e525129', '2fb274b7-1cec-4902-98e5-c5dce8beefbd', '3bc94a9d-4cb9-47e3-9827-175456913b18', '8e023096-3a39-4ff8-a748-dba12d4706ac'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:44 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD Nov 05 12:01:44 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:44 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:44 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1028a5e-7b88-47fa-85e7-76b455a75a60]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:45 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 Nov 05 12:01:45 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:45 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 is fetched for user 0963ed8a73a143bfa50221a4f3e03afd. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:01:45 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.429s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Deleted volume successfully. Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9f707dee-6855-4906-8f89-d31feabbd3f3 tempest-VolumeRetypeWithoutMigrationTest-1998371242 None] Lock "cinder-8b26bccd-0754-4ac6-8b01-936b680b2efb-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[68603a08-22d7-45d5-a4a7-c6c560a14cb7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:45 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" returned: 0 in 0.462s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:45 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD Nov 05 12:01:45 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:45 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524 Nov 05 12:01:45 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:45 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-51057773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2e002c-52cb-45ae-8ea8-8a2b0c83149d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e3b55a750e4cf8b57b5743c143c1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:44Z,use_quota=True,user_id='0963ed8a73a143bfa50221a4f3e03afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Creating volume 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:45 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:45 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d 1073741824 Nov 05 12:01:45 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:45 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" returned: 0 in 0.385s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-70ff3a6c-3dc5-4ec0-8cdc-2a5993204524" released by "delete_volume" :: held 0.949s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-8494bfba-200f-41a7-bb27-945fc7cc25b1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-8494bfba-200f-41a7-bb27-945fc7cc25b1" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3ff4bc-ef17-4a90-84b2-feec26c67014]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:46 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 Nov 05 12:01:46 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:46 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d 1073741824" returned: 0 in 0.662s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:46 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d Nov 05 12:01:46 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:46 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1" returned: 0 in 0.576s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:46 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1 Nov 05 12:01:46 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:46 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d" returned: 0 in 0.378s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:46 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8494bfba-200f-41a7-bb27-945fc7cc25b1" returned: 0 in 0.329s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-8494bfba-200f-41a7-bb27-945fc7cc25b1" released by "delete_volume" :: held 1.012s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Attempting download of 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[68297298-d27f-4265-89ca-d230e54b4ec0]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_y31c6o0s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:46 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['adead281-8970-47ec-8dbe-4ee0dd8b1a19'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:47 devstack cinder-volume[86942]: WARNING cinder.quota [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-953319802 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-953319802, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['fb354997-2683-49ea-a4f6-d76e00da3a0e', '42609053-2b34-4cbd-ac08-d1f809a75d56', '422354c8-422a-4aed-9291-2bf7847382bf', '2a58c0b7-f816-4b40-a69c-ac40b2bc03a5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:47 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_y31c6o0s Nov 05 12:01:47 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['5d96cfc4-6e17-40d4-a1ef-5ea4717dd35b', '795a8e5c-9681-4dd8-b0af-221cf376d72e', 'bb44e449-3686-44a6-951c-181b4467716e', 'd1b33ebf-d522-4dd3-bace-36c3b0225c72'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:47 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_y31c6o0s" returned: 0 in 0.461s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_y31c6o0s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:47 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:47 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:47 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_y31c6o0s Nov 05 12:01:47 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:47 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_y31c6o0s" returned: 1 in 0.449s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_y31c6o0s' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c044e6b-5bc0-4c4d-80a4-463c5f738cc6]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:47 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD Nov 05 12:01:47 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:47 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.507s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:48 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a47740db-885c-4f20-8f91-7695872df3d6 tempest-GroupSnapshotsTest-2112745905 None] Delete group completed successfully. Nov 05 12:01:48 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:48 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 was qcow2, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:01:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:48 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d Nov 05 12:01:48 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-28a4d55e-eba8-4746-9f98-cc25a6fdf5b5 tempest-GroupSnapshotsTest-2112745905 None] Group tempest-GroupSnapshotsTest-Group-1992785822: creating Nov 05 12:01:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-28a4d55e-eba8-4746-9f98-cc25a6fdf5b5 tempest-GroupSnapshotsTest-2112745905 None] Group tempest-GroupSnapshotsTest-Group-1992785822: created successfully Nov 05 12:01:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-28a4d55e-eba8-4746-9f98-cc25a6fdf5b5 tempest-GroupSnapshotsTest-2112745905 None] Create group completed successfully. Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (a8d208cd-b188-4628-aa12-06aa94f8185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:51 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f9ab9f-38ba-48e9-8831-3da1c933e194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d" returned: 0 in 2.980s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_r6zlm2gmdevstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:01:51 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Converted 112.00 MB image at 37.57 MB/s Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f9ab9f-38ba-48e9-8831-3da1c933e194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-788071693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8674ebe6-b3a4-4b7b-ae60-19c49a5b2a3c,host='devstack@QuobyteHD#QuobyteHD',id=c9f03ad4-28d8-42de-9ec6-63720bde843a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:51Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1590ee9d-e806-4a22-a458-a6c0d655d1c8),volume_type_id=1590ee9d-e806-4a22-a458-a6c0d655d1c8)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:51 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d 1G Nov 05 12:01:51 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a718a3-b248-4703-ad65-41a393f5812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a718a3-b248-4703-ad65-41a393f5812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8666dd-9bdb-4fd4-a0e2-2187ccf5b9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8666dd-9bdb-4fd4-a0e2-2187ccf5b9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f03ad4-28d8-42de-9ec6-63720bde843a', 'volume_name': 'volume-c9f03ad4-28d8-42de-9ec6-63720bde843a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede8928c-6644-46b9-90dd-02a2dc65259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede8928c-6644-46b9-90dd-02a2dc65259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65277c7b-98ed-4bae-8168-64d0bcdc6c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Volume c9f03ad4-28d8-42de-9ec6-63720bde843a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f03ad4-28d8-42de-9ec6-63720bde843a', 'volume_size': 1} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8674ebe6-b3a4-4b7b-ae60-19c49a5b2a3c,created_at=2026-11-05T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-788071693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8674ebe6-b3a4-4b7b-ae60-19c49a5b2a3c,host='devstack@QuobyteHD#QuobyteHD',id=c9f03ad4-28d8-42de-9ec6-63720bde843a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0670e9177b5f485790a12efa0d244a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:51Z,use_quota=True,user_id='2c2e8035d4944aa1af8a3ab5f6492e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1590ee9d-e806-4a22-a458-a6c0d655d1c8),volume_type_id=1590ee9d-e806-4a22-a458-a6c0d655d1c8)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Creating volume c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:51 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:51 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a 1073741824 Nov 05 12:01:51 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:51 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d 1G" returned: 0 in 0.686s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Downloaded image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 for user 0963ed8a73a143bfa50221a4f3e03afd is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:01:51 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Marking volume 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Copying metadata from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 to 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Creating volume glance metadata for volume 3f2e002c-52cb-45ae-8ea8-8a2b0c83149d backed by image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4e855d-ab6e-4cf8-87ae-e69a898d87e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71220576-9bab-4029-a219-09fede38743e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Volume volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d (3f2e002c-52cb-45ae-8ea8-8a2b0c83149d): created successfully Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71220576-9bab-4029-a219-09fede38743e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Flow 'volume_create_manager' (f181ad43-8718-4726-bd31-d68da1929a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:52 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a 1073741824" returned: 0 in 0.960s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e31efd49-ab37-40e4-91ba-5995bde98715 tempest-VolumesImageMetadata-1913630100 None] Created volume successfully. Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:52 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a Nov 05 12:01:52 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:52 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:52 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:52 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a" returned: 0 in 0.487s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65277c7b-98ed-4bae-8168-64d0bcdc6c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f03ad4-28d8-42de-9ec6-63720bde843a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1e7d75-b441-4573-94e7-0ecdb0367895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:53 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.514s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:53 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Volume volume-c9f03ad4-28d8-42de-9ec6-63720bde843a (c9f03ad4-28d8-42de-9ec6-63720bde843a): created successfully Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1e7d75-b441-4573-94e7-0ecdb0367895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Flow 'volume_create_manager' (a8d208cd-b188-4628-aa12-06aa94f8185d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:01:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-11e60328-bea1-4606-b854-f73f520c8ff0 tempest-GroupSnapshotsTest-2112745905 None] Created volume successfully. Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Acquiring lock "cinder-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Lock "cinder-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Acquiring lock "cinder-quobyte-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Lock "cinder-quobyte-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d8c0e0-9423-43cf-bd00-12e5bbd9da69]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:53 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d Nov 05 12:01:53 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:54 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] GroupSnapshot 9a63a41a-0f18-4911-8d42-c525b30d4a5d: creating. Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Group snapshot 9a63a41a-0f18-4911-8d42-c525b30d4a5d: creating. {{(pid=86942) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Creating offline snapshot dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 of volume c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:01:54 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d" returned: 0 in 0.623s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b1172-dff5-4834-a16a-3f703a9abc03]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:54 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d Nov 05 12:01:54 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:54 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a Nov 05 12:01:54 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:54 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d" returned: 0 in 0.379s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Lock "cinder-quobyte-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d" released by "delete_volume" :: held 1.077s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:54 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Created reservations ['f9875957-725d-48c7-8808-6e0db84620a9', '2724a1b0-d584-41f1-bd92-9e1a3bcf6277', '6644c4b8-1f51-4f24-8e50-8c1b77bb49c8', 'cc36a90a-4758-43d2-8a89-066ab86b19c5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:55 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a" returned: 0 in 0.641s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:55 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:01:55 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:55 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 1G Nov 05 12:01:55 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:55 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.356s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:01:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Deleted volume successfully. Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-65493e0a-a85f-4334-885a-0692a1408eea tempest-VolumesImageMetadata-1913630100 None] Lock "cinder-3f2e002c-52cb-45ae-8ea8-8a2b0c83149d-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:01:55 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 1G" returned: 0 in 0.766s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f03ad4-28d8-42de-9ec6-63720bde843a -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:55 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f03ad4-28d8-42de-9ec6-63720bde843a -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 Nov 05 12:01:55 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:01:56 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Flow 'volume_create_manager' (6ae5754e-1cf3-435d-9f2f-8a9cf015f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5108225d-2a0f-44df-ae8e-123624d90b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f03ad4-28d8-42de-9ec6-63720bde843a -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" returned: 0 in 0.590s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:56 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5108225d-2a0f-44df-ae8e-123624d90b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-45779735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf75db-bba1-446a-9134-9601b5c91fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdab2af7d964b4cb924945ae7ced3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:56Z,use_quota=True,user_id='5616a38c6018477a84de7be31971eccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79524e1-03fb-474c-bf62-c82a1cb2c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79524e1-03fb-474c-bf62-c82a1cb2c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:56 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 Nov 05 12:01:56 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c2bc6c-91b4-4b71-8b89-1a7b39bebb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c2bc6c-91b4-4b71-8b89-1a7b39bebb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cf75db-bba1-446a-9134-9601b5c91fbb', 'volume_name': 'volume-66cf75db-bba1-446a-9134-9601b5c91fbb', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f396c62-1359-45a7-89ed-145f38e15871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f396c62-1359-45a7-89ed-145f38e15871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0b1eee-f034-471d-89f8-ba439d248380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:56 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Volume 66cf75db-bba1-446a-9134-9601b5c91fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cf75db-bba1-446a-9134-9601b5c91fbb', 'volume_size': 1} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:56 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" returned: 0 in 0.355s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:56 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.info Nov 05 12:01:56 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:57 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.info" returned: 0 in 0.505s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:57 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:57 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.info Nov 05 12:01:57 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:57 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.info" returned: 0 in 0.326s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.310s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-45779735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf75db-bba1-446a-9134-9601b5c91fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdab2af7d964b4cb924945ae7ced3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:56Z,use_quota=True,user_id='5616a38c6018477a84de7be31971eccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Creating volume 66cf75db-bba1-446a-9134-9601b5c91fbb {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:01:57 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:01:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:57 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb 1073741824 Nov 05 12:01:57 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-222cff4f-b29a-4333-a8d4-792f41a9037c tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 9a63a41a-0f18-4911-8d42-c525b30d4a5d: created successfully Nov 05 12:01:58 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb 1073741824" returned: 0 in 0.615s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:58 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb Nov 05 12:01:58 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:58 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb" returned: 0 in 0.323s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0b1eee-f034-471d-89f8-ba439d248380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cf75db-bba1-446a-9134-9601b5c91fbb', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd55d15c-3b4c-4a48-a3d9-db7eea4bbb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:01:58 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Volume volume-66cf75db-bba1-446a-9134-9601b5c91fbb (66cf75db-bba1-446a-9134-9601b5c91fbb): created successfully Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd55d15c-3b4c-4a48-a3d9-db7eea4bbb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Flow 'volume_create_manager' (6ae5754e-1cf3-435d-9f2f-8a9cf015f82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:01:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-17509c08-0642-4f56-ad77-0f984599f016 tempest-VolumesServicesTestJSON-1886377343 None] Created volume successfully. Nov 05 12:01:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 9a63a41a-0f18-4911-8d42-c525b30d4a5d: deleting Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 9a63a41a-0f18-4911-8d42-c525b30d4a5d: deleting {{(pid=86942) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-c9f03ad4-28d8-42de-9ec6-63720bde843a" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-c9f03ad4-28d8-42de-9ec6-63720bde843a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Deleting offline snapshot dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 of volume c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] snapshot_file for this snap is: volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d288c4-a97c-48c7-83c9-37cc2d63c20c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:59 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 Nov 05 12:01:59 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:59 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" returned: 0 in 0.486s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f03ad4-28d8-42de-9ec6-63720bde843a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e4965-72e8-41c9-adb0-cc03e10fbeb2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:01:59 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a Nov 05 12:01:59 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Acquiring lock "cinder-66cf75db-bba1-446a-9134-9601b5c91fbb-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:01:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Lock "cinder-66cf75db-bba1-446a-9134-9601b5c91fbb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Acquiring lock "cinder-quobyte-66cf75db-bba1-446a-9134-9601b5c91fbb" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Lock "cinder-quobyte-66cf75db-bba1-446a-9134-9601b5c91fbb" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b89ab-c720-4cdb-9737-5c92ab6a4293]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:00 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb Nov 05 12:02:00 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:00 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a" returned: 0 in 0.790s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:00 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 Nov 05 12:02:00 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:00 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb" returned: 0 in 0.751s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:00 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb Nov 05 12:02:00 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:00 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" returned: 0 in 0.553s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:01 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6 Nov 05 12:02:01 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:01 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-66cf75db-bba1-446a-9134-9601b5c91fbb" returned: 0 in 0.478s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Lock "cinder-quobyte-66cf75db-bba1-446a-9134-9601b5c91fbb" released by "delete_volume" :: held 1.338s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:01 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a.dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" returned: 0 in 0.503s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-dec35f11-61cc-4fbb-bb8a-1b51e0abc1b6" released by "_delete_snapshot" :: held 2.533s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-c9f03ad4-28d8-42de-9ec6-63720bde843a" released by "delete_snapshot" :: held 2.590s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Created reservations ['6886c225-2baf-45de-89ac-eb12834b0836', '1ea0db26-298c-406c-b967-188d6617186f', '8d21c418-1f63-435e-a5e9-5eb625531127', '00d4a2d5-9c1d-47bd-90a3-2b85210b5ec1'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:02:01 devstack cinder-volume[86942]: WARNING cinder.quota [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-241397836 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-241397836, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:02:01 devstack cinder-volume[86942]: WARNING cinder.quota [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-241397836 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-241397836, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:01 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:02:01 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:01 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['044db9b9-9b93-4250-8949-93c4f1a7abdb', 'c362d690-c53d-4171-836c-185927944d90', '0e3bbee9-3c2f-4dbf-b162-96b74a4c0b23', '6fcce1a4-635c-4c36-bd5e-d800b921ac78'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:02:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f913605d-2d83-4b13-bcae-f6f3cbcbced9 tempest-GroupSnapshotsTest-2112745905 None] group_snapshot 9a63a41a-0f18-4911-8d42-c525b30d4a5d: deleted successfully Nov 05 12:02:02 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.592s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:02 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:02:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Deleted volume successfully. Nov 05 12:02:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c1b0e85d-e788-4531-a79e-7588fc7f8a56 tempest-VolumesServicesTestJSON-1886377343 None] Lock "cinder-66cf75db-bba1-446a-9134-9601b5c91fbb-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "cinder-quobyte-c9f03ad4-28d8-42de-9ec6-63720bde843a" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Flow 'volume_create_manager' (bfc3cb9f-9639-4a6c-a442-0b23b9fe3a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd5cb08-c757-4c64-8ddb-93b9d8093c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd5cb08-c757-4c64-8ddb-93b9d8093c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1783302056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c25623-204a-41f4-b069-4436f9a584d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab79d8ebf5a44ea9a1603440cd199221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:03Z,use_quota=True,user_id='be153bed0fe44acf96792e58957741d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c72d03-de4a-4977-b7bc-135a28701383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c72d03-de4a-4977-b7bc-135a28701383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2766049-e77f-4e0e-a5cb-763b4fe33e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2766049-e77f-4e0e-a5cb-763b4fe33e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c25623-204a-41f4-b069-4436f9a584d7', 'volume_name': 'volume-05c25623-204a-41f4-b069-4436f9a584d7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56543dc2-cb2b-4e75-ae1c-c4571da39fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56543dc2-cb2b-4e75-ae1c-c4571da39fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76468f28-553b-4043-8872-e30053afed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Volume 05c25623-204a-41f4-b069-4436f9a584d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c25623-204a-41f4-b069-4436f9a584d7', 'volume_size': 1} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1783302056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c25623-204a-41f4-b069-4436f9a584d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab79d8ebf5a44ea9a1603440cd199221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:03Z,use_quota=True,user_id='be153bed0fe44acf96792e58957741d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Creating volume 05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:02:03 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-c9f03ad4-28d8-42de-9ec6-63720bde843a" acquired by "delete_volume" :: waited 0.292s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:03 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 1073741824 Nov 05 12:02:03 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1433f3-3cbc-455e-822a-353b8e5605b3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:02:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:03 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a Nov 05 12:02:03 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:04 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a" returned: 0 in 0.670s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:04 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a Nov 05 12:02:04 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:04 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 1073741824" returned: 0 in 1.159s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:04 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 Nov 05 12:02:04 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:04 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c9f03ad4-28d8-42de-9ec6-63720bde843a" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Lock "cinder-quobyte-c9f03ad4-28d8-42de-9ec6-63720bde843a" released by "delete_volume" :: held 1.373s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['6b25d50a-d4dd-4bf4-bd63-401c30dec28b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:02:05 devstack cinder-volume[86942]: WARNING cinder.quota [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-241397836 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-241397836, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Created reservations ['ad13b571-b125-4c34-ab51-322f2a528440', '3704ab18-9809-4cb9-9876-defbc50af7cc', '3badf5e0-d861-4c90-a829-0317bab0dede', '38cf6d7c-6505-4724-9770-3fd4c54b669a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:02:05 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7" returned: 0 in 0.613s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76468f28-553b-4043-8872-e30053afed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c25623-204a-41f4-b069-4436f9a584d7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcad7a98-8729-4132-9115-c20ee5a073e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Volume volume-05c25623-204a-41f4-b069-4436f9a584d7 (05c25623-204a-41f4-b069-4436f9a584d7): created successfully Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcad7a98-8729-4132-9115-c20ee5a073e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Flow 'volume_create_manager' (bfc3cb9f-9639-4a6c-a442-0b23b9fe3a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-21ae5a4b-de85-4aa4-a75c-11910027cda0 tempest-SnapshotMetadataTestJSON-1876050379 None] Created volume successfully. Nov 05 12:02:05 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:02:05 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:05 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.361s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:05 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:02:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-463707ef-ba14-43d7-86ea-6ba500ec08bc tempest-GroupSnapshotsTest-2112745905 None] Delete group completed successfully. Nov 05 12:02:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Creating offline snapshot 74050bb8-d5ca-4e68-b522-2ddcb3421286 of volume 05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:02:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1adcb58-455d-4e2f-84f4-420eb889c83e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:02:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:07 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 Nov 05 12:02:07 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:07 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7" returned: 0 in 0.613s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:07 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 1G Nov 05 12:02:07 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:08 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 1G" returned: 0 in 0.662s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c25623-204a-41f4-b069-4436f9a584d7 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:08 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c25623-204a-41f4-b069-4436f9a584d7 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 Nov 05 12:02:08 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:08 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c25623-204a-41f4-b069-4436f9a584d7 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286" returned: 0 in 0.411s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:08 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 is being set with open permissions: ugo+rw Nov 05 12:02:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:08 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 Nov 05 12:02:08 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:09 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:09 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.info Nov 05 12:02:09 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:09 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.info" returned: 0 in 0.314s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:09 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.info is being set with open permissions: ugo+rw Nov 05 12:02:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:09 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.info Nov 05 12:02:09 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:09 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.info" returned: 0 in 0.328s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.852s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-956bea2e-c84e-4bc1-b4a6-486b504ce8dc tempest-SnapshotMetadataTestJSON-1876050379 None] Create snapshot completed successfully Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "cinder-74050bb8-d5ca-4e68-b522-2ddcb3421286-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-74050bb8-d5ca-4e68-b522-2ddcb3421286-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "cinder-quobyte-05c25623-204a-41f4-b069-4436f9a584d7" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-quobyte-05c25623-204a-41f4-b069-4436f9a584d7" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "cinder-quobyte-74050bb8-d5ca-4e68-b522-2ddcb3421286" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-quobyte-74050bb8-d5ca-4e68-b522-2ddcb3421286" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Deleting offline snapshot 74050bb8-d5ca-4e68-b522-2ddcb3421286 of volume 05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] snapshot_file for this snap is: volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a6a34d-3f96-4a4d-b516-d9521651b695]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:02:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:14 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 Nov 05 12:02:14 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:15 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286" returned: 0 in 1.675s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c25623-204a-41f4-b069-4436f9a584d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:02:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[45459aeb-3df2-42b7-9e6d-1eea4e68fb70]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:02:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:15 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 Nov 05 12:02:15 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:16 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7" returned: 0 in 0.769s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:16 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 Nov 05 12:02:16 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:17 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286" returned: 0 in 1.129s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:17 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286 Nov 05 12:02:17 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:18 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7.74050bb8-d5ca-4e68-b522-2ddcb3421286" returned: 0 in 0.825s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-quobyte-74050bb8-d5ca-4e68-b522-2ddcb3421286" released by "_delete_snapshot" :: held 4.798s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-quobyte-05c25623-204a-41f4-b069-4436f9a584d7" released by "delete_snapshot" :: held 4.874s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:18 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Created reservations ['bef0c846-3a00-45b2-87b3-a98cccef134d', 'a9fb3b98-95f3-4e9c-a399-fcb9da47afaa', '59cba002-a1ea-41f9-9941-48e3ac12a81a', 'add4cafc-061f-430d-88e7-e92f9bc009ff'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:02:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Delete snapshot completed successfully. Nov 05 12:02:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-26140efa-12d4-4d8f-9b27-03d779d8c2c8 tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-74050bb8-d5ca-4e68-b522-2ddcb3421286-delete_snapshot" released by "delete_snapshot" :: held 5.360s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "cinder-05c25623-204a-41f4-b069-4436f9a584d7-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:02:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-05c25623-204a-41f4-b069-4436f9a584d7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "cinder-quobyte-05c25623-204a-41f4-b069-4436f9a584d7" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:02:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-quobyte-05c25623-204a-41f4-b069-4436f9a584d7" acquired by "delete_volume" :: waited 0.060s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:02:20 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f9cf14-0b65-490a-b7a4-c1c306d69c06]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:02:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:20 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 Nov 05 12:02:20 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:20 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7" returned: 0 in 0.934s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:21 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7 Nov 05 12:02:21 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:21 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-05c25623-204a-41f4-b069-4436f9a584d7" returned: 0 in 0.426s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-quobyte-05c25623-204a-41f4-b069-4436f9a584d7" released by "delete_volume" :: held 1.524s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Created reservations ['73f64b34-28ff-41b6-a7e3-3f3da5c3a0f5', '38ab08d1-126a-4a25-8964-5a482ddc8d18', 'cd0b1b5d-538f-43f4-a71d-cc1d6f28162b', '4e96ebfc-a40e-4b53-a110-2d530e0bbb16'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:21 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:02:21 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:22 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.644s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:22 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:02:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Deleted volume successfully. Nov 05 12:02:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7049c48f-f6ff-4974-9af6-5da97bf0ed8d tempest-SnapshotMetadataTestJSON-1876050379 None] Lock "cinder-05c25623-204a-41f4-b069-4436f9a584d7-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:02:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c229e831-569e-4f2d-b3f7-e816f259d3a5 tempest-GroupsV320Test-1691951913 None] Group tempest-GroupsV320Test-Group-420397261: creating Nov 05 12:02:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c229e831-569e-4f2d-b3f7-e816f259d3a5 tempest-GroupsV320Test-1691951913 None] Group tempest-GroupsV320Test-Group-420397261: created successfully Nov 05 12:02:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c229e831-569e-4f2d-b3f7-e816f259d3a5 tempest-GroupsV320Test-1691951913 None] Create group completed successfully. Nov 05 12:02:25 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Created reservations ['a9e63f7a-4927-4434-b234-aba634b1044a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:02:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:25 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:02:25 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:26 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.824s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:26 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:02:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0e80851f-2cc8-452b-bb9b-bf67c2a73017 tempest-GroupsV320Test-1691951913 None] Delete group completed successfully. Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Flow 'volume_create_manager' (ee3862dc-8e8a-4116-9162-af942e9be60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89293e8-0ee1-4c9b-a160-7af012c74e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89293e8-0ee1-4c9b-a160-7af012c74e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2040446392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18503a25-4418-4883-bf10-a90a00b73c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601ac4f052534608a70514ddc60f9347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:28Z,use_quota=True,user_id='29b48b6df9364295b25b1274741dc98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23067d8-17d4-415a-908e-c49921611692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23067d8-17d4-415a-908e-c49921611692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f25bb99-d76b-4476-818f-e64dbdea8ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f25bb99-d76b-4476-818f-e64dbdea8ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18503a25-4418-4883-bf10-a90a00b73c71', 'volume_name': 'volume-18503a25-4418-4883-bf10-a90a00b73c71', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1148cf-1abe-462c-be7d-b97b1f8c2832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1148cf-1abe-462c-be7d-b97b1f8c2832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b815293-73b0-4fff-9f0c-339293bafa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:28 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Volume 18503a25-4418-4883-bf10-a90a00b73c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18503a25-4418-4883-bf10-a90a00b73c71', 'volume_size': 1} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2040446392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18503a25-4418-4883-bf10-a90a00b73c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601ac4f052534608a70514ddc60f9347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:28Z,use_quota=True,user_id='29b48b6df9364295b25b1274741dc98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Creating volume 18503a25-4418-4883-bf10-a90a00b73c71 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:02:28 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:02:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:28 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 1073741824 Nov 05 12:02:28 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:29 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 1073741824" returned: 0 in 0.799s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:29 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 Nov 05 12:02:29 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:29 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71" returned: 0 in 0.502s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b815293-73b0-4fff-9f0c-339293bafa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18503a25-4418-4883-bf10-a90a00b73c71', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a090f0-e62d-43c5-b42a-296eca241189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Volume volume-18503a25-4418-4883-bf10-a90a00b73c71 (18503a25-4418-4883-bf10-a90a00b73c71): created successfully Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a090f0-e62d-43c5-b42a-296eca241189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Flow 'volume_create_manager' (ee3862dc-8e8a-4116-9162-af942e9be60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:02:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-62d20d3d-b5f2-4368-b869-31cfa2767645 tempest-ServerRescueNegativeTestJSON-1971998240 None] Created volume successfully. Nov 05 12:02:39 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=98,cinder:UPDATE=107,cinder:INSERT=30,cinder:DELETE=4 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:02:39 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=90,cinder:UPDATE=109,cinder:INSERT=33,cinder:DELETE=6 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:52 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:02:52 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:52 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.473s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:02:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:02:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Flow 'volume_create_manager' (95b98f11-55c5-4981-900b-4d483173da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88531859-ef19-4ce8-8967-449fa93b5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88531859-ef19-4ce8-8967-449fa93b5443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1520033732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673d20ea-7108-43a1-b671-cd5c582aa234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b3f4421c414341a3a1056b18f5dcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:59Z,use_quota=True,user_id='be3c6df7ff224031864a96db992301a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623b4417-65a1-4e78-aee0-7243de1d916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623b4417-65a1-4e78-aee0-7243de1d916c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e06aa7-cb8f-4030-ac0d-baa8aacd70c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e06aa7-cb8f-4030-ac0d-baa8aacd70c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673d20ea-7108-43a1-b671-cd5c582aa234', 'volume_name': 'volume-673d20ea-7108-43a1-b671-cd5c582aa234', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4928903c-b917-41a0-a70a-1dada067d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4928903c-b917-41a0-a70a-1dada067d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a657cb4f-c30c-42ee-a59b-f5679f621170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:02:58 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Volume 673d20ea-7108-43a1-b671-cd5c582aa234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673d20ea-7108-43a1-b671-cd5c582aa234', 'volume_size': 1} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1520033732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673d20ea-7108-43a1-b671-cd5c582aa234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b3f4421c414341a3a1056b18f5dcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:59Z,use_quota=True,user_id='be3c6df7ff224031864a96db992301a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Creating volume 673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:02:58 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:02:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:58 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 1073741824 Nov 05 12:02:58 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:02:59 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Nov 05 12:02:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 1073741824" returned: 0 in 0.718s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:02:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:02:59 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:02:59 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:00 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:03:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a657cb4f-c30c-42ee-a59b-f5679f621170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673d20ea-7108-43a1-b671-cd5c582aa234', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3636d2-9cc4-42df-83fe-25cd6ec8ff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:00 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Volume volume-673d20ea-7108-43a1-b671-cd5c582aa234 (673d20ea-7108-43a1-b671-cd5c582aa234): created successfully Nov 05 12:03:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3636d2-9cc4-42df-83fe-25cd6ec8ff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Flow 'volume_create_manager' (95b98f11-55c5-4981-900b-4d483173da09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:03:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-70c0112a-bbf5-4a3a-9afa-c91e0d28cba4 tempest-VolumesActionsTest-1801966644 None] Created volume successfully. Nov 05 12:03:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Acquiring lock "cinder-18503a25-4418-4883-bf10-a90a00b73c71-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "cinder-18503a25-4418-4883-bf10-a90a00b73c71-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Acquiring lock "cinder-quobyte-18503a25-4418-4883-bf10-a90a00b73c71" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "cinder-quobyte-18503a25-4418-4883-bf10-a90a00b73c71" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:03 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6dcf83-207f-499e-ae76-5b37525fe1f0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:03:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:03 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 Nov 05 12:03:03 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:04 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71" returned: 0 in 1.001s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:04 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71 Nov 05 12:03:04 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:04 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-18503a25-4418-4883-bf10-a90a00b73c71" returned: 0 in 0.623s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "cinder-quobyte-18503a25-4418-4883-bf10-a90a00b73c71" released by "delete_volume" :: held 1.747s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Created reservations ['5dd53e84-db5d-4104-9b74-67877b8ddbe9', '419fd278-ae68-4ded-8ad1-f91cbc62f937', '0cb15e4a-06ef-4bda-b9a6-e24486a666e1', '25155741-cdc1-48f8-ad33-a89f4d66080c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:05 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:03:05 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:05 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.690s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:05 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:03:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Deleted volume successfully. Nov 05 12:03:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b919ac2-bd68-4a38-b472-a59b8d3c0a6e tempest-ServerRescueNegativeTestJSON-1971998240 None] Lock "cinder-18503a25-4418-4883-bf10-a90a00b73c71-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:14 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:INSERT=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:03:15 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:03:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9321beb1-1dd0-448c-a36a-d0d7fee10352 tempest-VolumesActionsTest-1801966644 None] Acquiring lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234" by "attach_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9321beb1-1dd0-448c-a36a-d0d7fee10352 tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234" acquired by "attach_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9321beb1-1dd0-448c-a36a-d0d7fee10352 tempest-VolumesActionsTest-1801966644 None] Attaching volume 673d20ea-7108-43a1-b671-cd5c582aa234 to instance 680510e4-8dec-46b6-90d9-8449fc84652c at mountpoint /dev/vdb on host None. Nov 05 12:03:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9321beb1-1dd0-448c-a36a-d0d7fee10352 tempest-VolumesActionsTest-1801966644 None] Attach volume completed successfully. Nov 05 12:03:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9321beb1-1dd0-448c-a36a-d0d7fee10352 tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234" released by "attach_volume" :: held 0.222s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-71a9776e-3daf-483b-a7a6-251dcd0eff71 tempest-VolumesActionsTest-1801966644 None] Acquiring lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-detach_volume" by "detach_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-71a9776e-3daf-483b-a7a6-251dcd0eff71 tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-71a9776e-3daf-483b-a7a6-251dcd0eff71 tempest-VolumesActionsTest-1801966644 None] Detaching volume 673d20ea-7108-43a1-b671-cd5c582aa234 from instance 680510e4-8dec-46b6-90d9-8449fc84652c. Nov 05 12:03:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-71a9776e-3daf-483b-a7a6-251dcd0eff71 tempest-VolumesActionsTest-1801966644 None] Detach volume completed successfully. Nov 05 12:03:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-71a9776e-3daf-483b-a7a6-251dcd0eff71 tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:29 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:03:29 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:INSERT=1,cinder:SELECT=9 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Flow 'volume_create_manager' (0457384a-1bfe-40b6-b298-22e9283a7bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f965c115-851a-4a6c-83ff-3e47a540d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (f65a2a3a-3ade-43f9-994f-eb3c3e4c3c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f6cf90-27a9-4997-bc8e-8b0910064dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f965c115-851a-4a6c-83ff-3e47a540d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-747172144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3594f0-7b5b-485c-8614-58bc2240d127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3c0fae52a444098afbbe5b2e97229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:37Z,use_quota=True,user_id='875f9a7022a943a69527440ce447c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed8b3a3-0581-4bb1-bec4-9c7e37dcb862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed8b3a3-0581-4bb1-bec4-9c7e37dcb862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f564e1-1e18-4ac3-9a8b-9bc9db19cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f564e1-1e18-4ac3-9a8b-9bc9db19cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3594f0-7b5b-485c-8614-58bc2240d127', 'volume_name': 'volume-8a3594f0-7b5b-485c-8614-58bc2240d127', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3036f19d-d596-486c-b1a4-38b9f234c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3036f19d-d596-486c-b1a4-38b9f234c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1dc200-80a4-4dd2-bac5-fbd5a97f8fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Volume 8a3594f0-7b5b-485c-8614-58bc2240d127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3594f0-7b5b-485c-8614-58bc2240d127', 'volume_size': 1} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-747172144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3594f0-7b5b-485c-8614-58bc2240d127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3c0fae52a444098afbbe5b2e97229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:37Z,use_quota=True,user_id='875f9a7022a943a69527440ce447c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Creating volume 8a3594f0-7b5b-485c-8614-58bc2240d127 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:03:37 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f6cf90-27a9-4997-bc8e-8b0910064dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1377757243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df6cf68-b022-475e-a092-037a3e68d1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:37Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94951ad6-2b9b-4461-8110-bd1c30ec7adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94951ad6-2b9b-4461-8110-bd1c30ec7adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484d1972-28cf-4523-9eb3-e0fd90d3b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484d1972-28cf-4523-9eb3-e0fd90d3b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df6cf68-b022-475e-a092-037a3e68d1dc', 'volume_name': 'volume-1df6cf68-b022-475e-a092-037a3e68d1dc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 1073741824 Nov 05 12:03:37 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78ec4a7-8886-426d-8559-168fd4bfa080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78ec4a7-8886-426d-8559-168fd4bfa080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74d0717-8a2a-4e53-b43c-75d87b8fe166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:37 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Volume 1df6cf68-b022-475e-a092-037a3e68d1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df6cf68-b022-475e-a092-037a3e68d1dc', 'volume_size': 1} Nov 05 12:03:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:39 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 1073741824" returned: 0 in 1.450s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:39 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 Nov 05 12:03:39 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:39 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.752s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1377757243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df6cf68-b022-475e-a092-037a3e68d1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:37Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Creating volume 1df6cf68-b022-475e-a092-037a3e68d1dc {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:03:39 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:39 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc 1073741824 Nov 05 12:03:39 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1dc200-80a4-4dd2-bac5-fbd5a97f8fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3594f0-7b5b-485c-8614-58bc2240d127', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a3d49b-67e4-4633-9e3e-8585289e2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:39 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Volume volume-8a3594f0-7b5b-485c-8614-58bc2240d127 (8a3594f0-7b5b-485c-8614-58bc2240d127): created successfully Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a3d49b-67e4-4633-9e3e-8585289e2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Flow 'volume_create_manager' (0457384a-1bfe-40b6-b298-22e9283a7bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:03:39 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e0844154-a8df-453e-8084-72c19ec1aff8 tempest-VolumeQuotasNegativeTestJSON-599810683 None] Created volume successfully. Nov 05 12:03:40 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc 1073741824" returned: 0 in 0.993s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:40 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc Nov 05 12:03:40 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:41 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc" returned: 0 in 0.492s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74d0717-8a2a-4e53-b43c-75d87b8fe166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df6cf68-b022-475e-a092-037a3e68d1dc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f65b0bf-b2a0-481d-a47c-07ac46269101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Volume volume-1df6cf68-b022-475e-a092-037a3e68d1dc (1df6cf68-b022-475e-a092-037a3e68d1dc): created successfully Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f65b0bf-b2a0-481d-a47c-07ac46269101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (f65a2a3a-3ade-43f9-994f-eb3c3e4c3c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8e685f51-c6d7-4c05-8495-1e9b21e17b79 tempest-VolumesActionsTest-1801966644 None] Acquiring lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234" by "attach_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9ade0727-5251-4040-ae5f-71eb81618ece tempest-VolumesActionsTest-628530106 None] Created volume successfully. Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8e685f51-c6d7-4c05-8495-1e9b21e17b79 tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234" acquired by "attach_volume" :: waited 0.059s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8e685f51-c6d7-4c05-8495-1e9b21e17b79 tempest-VolumesActionsTest-1801966644 None] Attaching volume 673d20ea-7108-43a1-b671-cd5c582aa234 to instance 0913be55-bfab-44b5-a68f-08695a518d1e at mountpoint /dev/vdb on host None. Nov 05 12:03:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8e685f51-c6d7-4c05-8495-1e9b21e17b79 tempest-VolumesActionsTest-1801966644 None] Attach volume completed successfully. Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8e685f51-c6d7-4c05-8495-1e9b21e17b79 tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234" released by "attach_volume" :: held 0.179s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cd5fb5a3-32ab-4171-b23e-b0b26dc34dff tempest-VolumesActionsTest-628530106 None] Acquiring lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc" by "attach_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cd5fb5a3-32ab-4171-b23e-b0b26dc34dff tempest-VolumesActionsTest-628530106 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc" acquired by "attach_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-cd5fb5a3-32ab-4171-b23e-b0b26dc34dff tempest-VolumesActionsTest-628530106 None] Attaching volume 1df6cf68-b022-475e-a092-037a3e68d1dc to instance d3d67bce-a743-40df-9a8b-bff9a075c0c6 at mountpoint /dev/vdb on host None. Nov 05 12:03:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-cd5fb5a3-32ab-4171-b23e-b0b26dc34dff tempest-VolumesActionsTest-628530106 None] Attach volume completed successfully. Nov 05 12:03:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cd5fb5a3-32ab-4171-b23e-b0b26dc34dff tempest-VolumesActionsTest-628530106 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc" released by "attach_volume" :: held 0.173s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-05d61346-6cb1-4da4-bdb2-57bf097872de tempest-VolumesActionsTest-1801966644 None] Acquiring lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-detach_volume" by "detach_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-05d61346-6cb1-4da4-bdb2-57bf097872de tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-05d61346-6cb1-4da4-bdb2-57bf097872de tempest-VolumesActionsTest-1801966644 None] Detaching volume 673d20ea-7108-43a1-b671-cd5c582aa234 from instance 0913be55-bfab-44b5-a68f-08695a518d1e. Nov 05 12:03:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-05d61346-6cb1-4da4-bdb2-57bf097872de tempest-VolumesActionsTest-1801966644 None] Detach volume completed successfully. Nov 05 12:03:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-05d61346-6cb1-4da4-bdb2-57bf097872de tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Acquiring lock "cinder-8a3594f0-7b5b-485c-8614-58bc2240d127-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "cinder-8a3594f0-7b5b-485c-8614-58bc2240d127-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Acquiring lock "cinder-quobyte-8a3594f0-7b5b-485c-8614-58bc2240d127" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "cinder-quobyte-8a3594f0-7b5b-485c-8614-58bc2240d127" acquired by "delete_volume" :: waited 0.060s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:44 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f96d51-eda2-4256-88cc-5d541784a346]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:03:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:44 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-eed76b01-fed4-4cf5-abe3-2bf4e2a4c2e0 tempest-VolumesActionsTest-949967807 None] Terminate volume connection completed successfully. Nov 05 12:03:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-eed76b01-fed4-4cf5-abe3-2bf4e2a4c2e0 tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-detach_volume" by "detach_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:44 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 Nov 05 12:03:44 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-eed76b01-fed4-4cf5-abe3-2bf4e2a4c2e0 tempest-VolumesActionsTest-949967807 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:44 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-eed76b01-fed4-4cf5-abe3-2bf4e2a4c2e0 tempest-VolumesActionsTest-949967807 None] Detaching volume 1df6cf68-b022-475e-a092-037a3e68d1dc from instance d3d67bce-a743-40df-9a8b-bff9a075c0c6. Nov 05 12:03:44 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-eed76b01-fed4-4cf5-abe3-2bf4e2a4c2e0 tempest-VolumesActionsTest-949967807 None] Detach volume completed successfully. Nov 05 12:03:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-eed76b01-fed4-4cf5-abe3-2bf4e2a4c2e0 tempest-VolumesActionsTest-949967807 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:45 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-06fb80f5-74a7-4158-8573-3d086b3b8795 tempest-VolumesActionsTest-628530106 None] Acquiring lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-detach_volume" by "detach_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127" returned: 0 in 0.895s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-06fb80f5-74a7-4158-8573-3d086b3b8795 tempest-VolumesActionsTest-628530106 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-06fb80f5-74a7-4158-8573-3d086b3b8795 tempest-VolumesActionsTest-628530106 None] Volume detach called, but volume not attached. Nov 05 12:03:45 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127 Nov 05 12:03:45 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-06fb80f5-74a7-4158-8573-3d086b3b8795 tempest-VolumesActionsTest-628530106 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:45 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8a3594f0-7b5b-485c-8614-58bc2240d127" returned: 0 in 0.472s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Acquiring lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "cinder-quobyte-8a3594f0-7b5b-485c-8614-58bc2240d127" released by "delete_volume" :: held 1.598s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Acquiring lock "cinder-quobyte-1df6cf68-b022-475e-a092-037a3e68d1dc" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Created reservations ['0240d479-bb38-4096-aa77-e04fcc67c0d9', '8bf1935d-aef0-430e-b040-530ad0652949', 'd9099ba1-b231-49bf-9953-9d0ec3fad73c', '9e70e69b-7896-4559-90e2-621c7efec717'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Lock "cinder-quobyte-1df6cf68-b022-475e-a092-037a3e68d1dc" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d744495-8be0-432c-b323-a5e38c1936f4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:45 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc Nov 05 12:03:45 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:45 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:03:45 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:46 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.314s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:46 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:03:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Deleted volume successfully. Nov 05 12:03:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-46044cc5-5059-4f8d-8c6e-cba41727e38b tempest-VolumeQuotasNegativeTestJSON-599810683 None] Lock "cinder-8a3594f0-7b5b-485c-8614-58bc2240d127-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:46 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc" returned: 0 in 0.691s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:46 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc Nov 05 12:03:46 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:46 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1df6cf68-b022-475e-a092-037a3e68d1dc" returned: 0 in 0.450s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Lock "cinder-quobyte-1df6cf68-b022-475e-a092-037a3e68d1dc" released by "delete_volume" :: held 1.211s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Created reservations ['0044777a-f32f-4928-9c4b-0efb64210000', '02a3ff4e-18c7-4876-a08b-e7b2d5e5a750', 'ce911840-ffbe-4b05-8fb3-ee02d6b011ae', 'e4910c8a-daf2-44cd-ad05-4c109c1d6250'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:47 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:03:47 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:47 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.334s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:03:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Deleted volume successfully. Nov 05 12:03:47 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-88a304d0-877b-4e51-9062-21f20181b975 tempest-VolumesActionsTest-628530106 None] Lock "cinder-1df6cf68-b022-475e-a092-037a3e68d1dc-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:03:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:50 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b022e-3094-4f16-aa1d-63bcf1137ea9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:03:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:50 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:03:50 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:51 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.494s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:51 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[141b3b5c-612e-4a6e-ad8c-5dbe17490b71]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:03:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:51 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:03:51 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:51 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.672s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.4c5d1af0-4724-4d2c-a5ca-8cb01bac417djueknf0v.img {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:51 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.4c5d1af0-4724-4d2c-a5ca-8cb01bac417djueknf0v.img Nov 05 12:03:51 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:03:52 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:03:52 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:03:52 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.378s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:03:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:03:57 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:03:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (125e6d9c-7975-4512-af5e-ba5c4f370aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:03:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b148ecd9-3ab3-4fed-a046-84bf2b15e055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b148ecd9-3ab3-4fed-a046-84bf2b15e055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848842789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbfc287-c9ee-4fc5-ae4d-f22ac32c9533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:58Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba2b54e-8d3b-4231-9b80-a6cc7fe17a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba2b54e-8d3b-4231-9b80-a6cc7fe17a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed0cc6-0ff0-434d-bc80-7044fc6ccfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed0cc6-0ff0-434d-bc80-7044fc6ccfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acbfc287-c9ee-4fc5-ae4d-f22ac32c9533', 'volume_name': 'volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0049f1f-bb52-43e1-aa53-94187a907e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0049f1f-bb52-43e1-aa53-94187a907e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa24dbf-18dd-4d90-90b6-26fda7d72211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:03:58 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Volume acbfc287-c9ee-4fc5-ae4d-f22ac32c9533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533', 'volume_size': 1} Nov 05 12:03:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:01 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.4c5d1af0-4724-4d2c-a5ca-8cb01bac417djueknf0v.img" returned: 0 in 9.966s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[462dcdf1-2c78-47e8-afc4-55d39f646c9d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:02 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:04:02 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:02 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.668s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:02 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234, size 1024.00 MB, duration 9.97 sec, destination /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.4c5d1af0-4724-4d2c-a5ca-8cb01bac417djueknf0v.img {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:04:02 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Converted 1024.00 MB image at 102.73 MB/s Nov 05 12:04:02 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] 4c5d1af0-4724-4d2c-a5ca-8cb01bac417d was raw, no need to convert to raw {{(pid=86942) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Flow 'volume_create_manager' (8cc0b8cd-4836-4808-bc33-bdac8b271c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db1e9d8-475b-48a6-82dd-0f4d0ebbe36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db1e9d8-475b-48a6-82dd-0f4d0ebbe36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1014025754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2903b6fa-5651-4756-a93c-b2a0cda307e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abdae166542a48aeb67cdb14e1c89e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:03Z,use_quota=True,user_id='d9c7d067364541e4ac04d8dd53a5b8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb18d03-0793-40d4-be45-e3be412f0ec1),volume_type_id=6eb18d03-0793-40d4-be45-e3be412f0ec1)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e79643-4142-40aa-ade0-7bf93219a10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e79643-4142-40aa-ade0-7bf93219a10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d552de5-8f11-43bd-afa9-6e59b1b04615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d552de5-8f11-43bd-afa9-6e59b1b04615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2903b6fa-5651-4756-a93c-b2a0cda307e5', 'volume_name': 'volume-2903b6fa-5651-4756-a93c-b2a0cda307e5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4704c1c-9a8c-4108-b9e4-ad29a7674ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4704c1c-9a8c-4108-b9e4-ad29a7674ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419945ba-a636-41cf-9cda-7472f8e7789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Volume 2903b6fa-5651-4756-a93c-b2a0cda307e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2903b6fa-5651-4756-a93c-b2a0cda307e5', 'volume_size': 1} Nov 05 12:04:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:13 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:04:13 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=37,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.908s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Uploaded volume to glance image-id: 4c5d1af0-4724-4d2c-a5ca-8cb01bac417d. {{(pid=86942) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.436s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848842789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbfc287-c9ee-4fc5-ae4d-f22ac32c9533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:58Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Creating volume acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:04:26 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:04:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:26 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 1073741824 Nov 05 12:04:26 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-af83af78-efba-49e1-af70-da09dc7a666b tempest-VolumesActionsTest-1801966644 None] Copy volume to image completed successfully. Nov 05 12:04:27 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 1073741824" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:27 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 Nov 05 12:04:27 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:27 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.994s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1014025754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2903b6fa-5651-4756-a93c-b2a0cda307e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abdae166542a48aeb67cdb14e1c89e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:03Z,use_quota=True,user_id='d9c7d067364541e4ac04d8dd53a5b8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb18d03-0793-40d4-be45-e3be412f0ec1),volume_type_id=6eb18d03-0793-40d4-be45-e3be412f0ec1)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Creating volume 2903b6fa-5651-4756-a93c-b2a0cda307e5 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:04:27 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa24dbf-18dd-4d90-90b6-26fda7d72211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f820f1-d629-46da-ae59-229d00e18d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:27 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 1073741824 Nov 05 12:04:27 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:27 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Volume volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 (acbfc287-c9ee-4fc5-ae4d-f22ac32c9533): created successfully Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f820f1-d629-46da-ae59-229d00e18d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (125e6d9c-7975-4512-af5e-ba5c4f370aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0377ce0e-aa62-4ea0-ba4e-d3ff8ea9fcdb tempest-VolumesActionsTest-628530106 None] Created volume successfully. Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:27 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 1073741824" returned: 0 in 0.492s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:28 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 Nov 05 12:04:28 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:28 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5" returned: 0 in 0.303s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.517s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419945ba-a636-41cf-9cda-7472f8e7789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2903b6fa-5651-4756-a93c-b2a0cda307e5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133ddbc2-001a-448f-a05b-b7f2851ce54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[829f9274-eb35-456a-8ffc-fbef22d35d47]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:28 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Volume volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 (2903b6fa-5651-4756-a93c-b2a0cda307e5): created successfully Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133ddbc2-001a-448f-a05b-b7f2851ce54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Flow 'volume_create_manager' (8cc0b8cd-4836-4808-bc33-bdac8b271c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:28 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7a52785e-dac3-4f7f-9c22-d22df4828ede tempest-VolumeTypesAccessTest-1227953629 None] Created volume successfully. Nov 05 12:04:28 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:04:28 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Lock "cinder-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-quobyte-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Acquiring lock "cinder-2903b6fa-5651-4756-a93c-b2a0cda307e5-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Lock "cinder-2903b6fa-5651-4756-a93c-b2a0cda307e5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374291a-e4d4-4079-8b07-876db7ee440b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Acquiring lock "cinder-quobyte-2903b6fa-5651-4756-a93c-b2a0cda307e5" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Lock "cinder-quobyte-2903b6fa-5651-4756-a93c-b2a0cda307e5" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1444d927-4719-4884-85ed-8002277123f4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:28 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.508s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:28 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 Nov 05 12:04:28 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cf7f53-400b-47d0-b5c1-9349df1792ff]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:28 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 Nov 05 12:04:28 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:28 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:04:28 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:29 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533" returned: 0 in 0.406s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:29 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533 Nov 05 12:04:29 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:29 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5" returned: 0 in 0.439s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:29 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5 Nov 05 12:04:29 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:29 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.457s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:29 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img Nov 05 12:04:29 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:29 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533" returned: 0 in 0.301s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533" released by "delete_volume" :: held 0.781s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Created reservations ['faedbc4e-bb2c-4fbc-9ac2-2b5295277850', '1c63b630-6468-4290-aadf-3753fc9540e1', '774a0540-de50-4af2-8e01-d59bd2973563', 'e5536542-c417-4373-b549-355136db6abd'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:29 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:04:29 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:29 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2903b6fa-5651-4756-a93c-b2a0cda307e5" returned: 0 in 0.337s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Lock "cinder-quobyte-2903b6fa-5651-4756-a93c-b2a0cda307e5" released by "delete_volume" :: held 0.846s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:29 devstack cinder-volume[86942]: WARNING cinder.quota [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1023051165 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1023051165, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:04:29 devstack cinder-volume[86942]: WARNING cinder.quota [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1023051165 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1023051165, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:04:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Created reservations ['ae917204-7b11-4335-ac6c-47cb282c1ced', '35918f69-a3b9-4d99-a1f4-23ae8788dddf', 'e97bd086-e05b-4693-94f5-713e5048add5', 'a3abc251-b3d6-4c09-afeb-22b645c88c33'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:30 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:04:30 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:30 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.540s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:04:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Deleted volume successfully. Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b07d83ca-3ad3-4a59-adb2-ebc7276e967f tempest-VolumesActionsTest-949967807 None] Lock "cinder-acbfc287-c9ee-4fc5-ae4d-f22ac32c9533-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:30 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.700s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:04:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Deleted volume successfully. Nov 05 12:04:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2d98ac7c-b61e-4015-a0e4-7d8b79ae6349 tempest-VolumeTypesAccessTest-1227953629 None] Lock "cinder-2903b6fa-5651-4756-a93c-b2a0cda307e5-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (df1e02ee-ecfa-42fd-9186-e03e152c03c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b39c611-9450-4db7-8df4-eabb484d3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b39c611-9450-4db7-8df4-eabb484d3abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046896731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd89066-29ef-4e5f-b906-22bc07802d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:31Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a748d5-a109-44a7-ae20-6d8000db888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a748d5-a109-44a7-ae20-6d8000db888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5669141a-5cf7-4765-893c-44f1bb9eb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5669141a-5cf7-4765-893c-44f1bb9eb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd89066-29ef-4e5f-b906-22bc07802d9c', 'volume_name': 'volume-6dd89066-29ef-4e5f-b906-22bc07802d9c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5172eb-0f56-43f5-924b-0ebb3c5ada3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5172eb-0f56-43f5-924b-0ebb3c5ada3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db171ddd-d52d-450a-8307-f46a8717005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Volume 6dd89066-29ef-4e5f-b906-22bc07802d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd89066-29ef-4e5f-b906-22bc07802d9c', 'volume_size': 1} Nov 05 12:04:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Flow 'volume_create_manager' (517dd15b-b184-49e9-84e3-63c478a4302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2448b68c-453b-4c24-8369-67dbcc248a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2448b68c-453b-4c24-8369-67dbcc248a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1383137824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9722c0a-a4bc-474f-896b-5450cb84075b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607611d1906f4cf7a878353e7811dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:36Z,use_quota=True,user_id='f51ba5ab57f9486db3584a9b5c44f092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ca7c9d-906d-4ce5-bc9b-d0e71f4613f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ca7c9d-906d-4ce5-bc9b-d0e71f4613f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d87aeff-598d-40a4-9236-08fe730b1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d87aeff-598d-40a4-9236-08fe730b1468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9722c0a-a4bc-474f-896b-5450cb84075b', 'volume_name': 'volume-d9722c0a-a4bc-474f-896b-5450cb84075b', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851da34c-059c-48a9-8994-f333bcc19595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851da34c-059c-48a9-8994-f333bcc19595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded8ddfb-24d5-4d75-a115-eabc3ffa460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:36 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Volume d9722c0a-a4bc-474f-896b-5450cb84075b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9722c0a-a4bc-474f-896b-5450cb84075b', 'volume_size': 1} Nov 05 12:04:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:37 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img" returned: 0 in 8.429s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:37 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[859a60d1-fd92-46b6-b36c-5c48be04b76d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:37 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:04:37 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:38 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.596s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:38 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:04:38 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Converted 1024.00 MB image at 121.45 MB/s Nov 05 12:04:38 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] f4681f5f-139b-469e-b017-c9e69e73ceb6 was raw, converting to qcow2 {{(pid=86942) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 12:04:38 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a90daaa-9e7b-4211-a9e5-f95edaab2f98]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:38 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img Nov 05 12:04:38 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:38 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img" returned: 0 in 0.430s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:38 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img Nov 05 12:04:38 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:39 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img" returned: 1 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img /opt/stack/data/cinder/conversion/vol_upload_d9d7c9ou {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:39 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img /opt/stack/data/cinder/conversion/vol_upload_d9d7c9ou Nov 05 12:04:39 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:39 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img /opt/stack/data/cinder/conversion/vol_upload_d9d7c9ou" returned: 0 in 0.310s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Image conversion details: src /opt/stack/data/cinder/conversion/673d20ea-7108-43a1-b671-cd5c582aa234.temp_image.f4681f5f-139b-469e-b017-c9e69e73ceb6j9vayg72.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_d9d7c9ou {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:04:39 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6bae2b-ba66-4e1d-99e2-d853a5291e96]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d9d7c9ou {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:39 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d9d7c9ou Nov 05 12:04:39 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:39 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d9d7c9ou" returned: 0 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.502s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Uploaded volume to glance image-id: f4681f5f-139b-469e-b017-c9e69e73ceb6. {{(pid=86942) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.560s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046896731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd89066-29ef-4e5f-b906-22bc07802d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:31Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Creating volume 6dd89066-29ef-4e5f-b906-22bc07802d9c {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:04:41 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:04:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:41 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c 1073741824 Nov 05 12:04:41 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-aac05065-de56-4dc0-ae42-029b92df77bd tempest-VolumesActionsTest-1801966644 None] Copy volume to image completed successfully. Nov 05 12:04:42 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c 1073741824" returned: 0 in 0.597s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:42 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c Nov 05 12:04:42 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Flow 'volume_create_manager' (b00c13f9-a336-4e49-ae17-557f07fa28cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8835eb27-1543-4642-a9c5-dfdb28ba9a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:42 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8835eb27-1543-4642-a9c5-dfdb28ba9a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1467773677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327fc56c-231c-4ab8-9939-66b91b0a72b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34483606ff334fb995b3016272f14e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:43Z,use_quota=True,user_id='ddfbf860928d43278e4e9a2f41761243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174603f7-57a4-4a59-86c4-bb18d77df6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174603f7-57a4-4a59-86c4-bb18d77df6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7de92cf-c5cc-4580-957d-2e97c9e3f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7de92cf-c5cc-4580-957d-2e97c9e3f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327fc56c-231c-4ab8-9939-66b91b0a72b2', 'volume_name': 'volume-327fc56c-231c-4ab8-9939-66b91b0a72b2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a88dd8-a328-4dda-989f-cfaf84724e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a88dd8-a328-4dda-989f-cfaf84724e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41143fb-a503-4802-8eac-f839b03e3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Volume 327fc56c-231c-4ab8-9939-66b91b0a72b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327fc56c-231c-4ab8-9939-66b91b0a72b2', 'volume_size': 1} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c" returned: 0 in 0.366s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.431s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1383137824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9722c0a-a4bc-474f-896b-5450cb84075b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607611d1906f4cf7a878353e7811dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:36Z,use_quota=True,user_id='f51ba5ab57f9486db3584a9b5c44f092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Creating volume d9722c0a-a4bc-474f-896b-5450cb84075b {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:04:42 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:42 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b 1073741824 Nov 05 12:04:42 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db171ddd-d52d-450a-8307-f46a8717005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd89066-29ef-4e5f-b906-22bc07802d9c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64616393-4b5e-43a6-8434-7c04a66577c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Volume volume-6dd89066-29ef-4e5f-b906-22bc07802d9c (6dd89066-29ef-4e5f-b906-22bc07802d9c): created successfully Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64616393-4b5e-43a6-8434-7c04a66577c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (df1e02ee-ecfa-42fd-9186-e03e152c03c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f2569e9a-2630-464a-8399-5e6b6d80d842 tempest-VolumesActionsTest-628530106 None] Created volume successfully. Nov 05 12:04:43 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b 1073741824" returned: 0 in 0.523s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Acquiring lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:43 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b Nov 05 12:04:43 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Acquiring lock "cinder-quobyte-673d20ea-7108-43a1-b671-cd5c582aa234" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Lock "cinder-quobyte-673d20ea-7108-43a1-b671-cd5c582aa234" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9209c0a-9efe-4eea-b351-23024e3630b6]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:43 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:04:43 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:43 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b" returned: 0 in 0.307s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1467773677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327fc56c-231c-4ab8-9939-66b91b0a72b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34483606ff334fb995b3016272f14e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:43Z,use_quota=True,user_id='ddfbf860928d43278e4e9a2f41761243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Creating volume 327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:04:43 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded8ddfb-24d5-4d75-a115-eabc3ffa460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9722c0a-a4bc-474f-896b-5450cb84075b', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:43 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 1073741824 Nov 05 12:04:43 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b3760-6679-4e0e-86ee-3486ff9a3623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:43 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Volume volume-d9722c0a-a4bc-474f-896b-5450cb84075b (d9722c0a-a4bc-474f-896b-5450cb84075b): created successfully Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b3760-6679-4e0e-86ee-3486ff9a3623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Flow 'volume_create_manager' (517dd15b-b184-49e9-84e3-63c478a4302c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e08ec083-7143-4487-bab5-5e4f4d51b5b4 tempest-AttachVolumeTestJSON-1534323722 None] Created volume successfully. Nov 05 12:04:44 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.440s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:44 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234 Nov 05 12:04:44 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-6dd89066-29ef-4e5f-b906-22bc07802d9c-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Lock "cinder-6dd89066-29ef-4e5f-b906-22bc07802d9c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:44 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 1073741824" returned: 0 in 0.596s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:44 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-673d20ea-7108-43a1-b671-cd5c582aa234" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Lock "cinder-quobyte-673d20ea-7108-43a1-b671-cd5c582aa234" released by "delete_volume" :: held 0.845s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-quobyte-6dd89066-29ef-4e5f-b906-22bc07802d9c" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-6dd89066-29ef-4e5f-b906-22bc07802d9c" acquired by "delete_volume" :: waited 0.045s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:44 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 Nov 05 12:04:44 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[773b671a-a7da-477d-8257-2d838902b506]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Created reservations ['9aa7cf8e-700b-4d61-a3dd-b9aac8b7fb96', 'd2896ffd-3d86-4aa7-8f88-6b656a96190c', '9da3f7d8-f9de-424e-9b5e-789a47d63689', 'fd9f27ae-e182-4fc5-ba69-70b054b584d4'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:04:44 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c Nov 05 12:04:44 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:44 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:04:44 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:44 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41143fb-a503-4802-8eac-f839b03e3256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327fc56c-231c-4ab8-9939-66b91b0a72b2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7264bfd4-4e91-4896-a055-e51b21b814ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:44 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Volume volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 (327fc56c-231c-4ab8-9939-66b91b0a72b2): created successfully Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7264bfd4-4e91-4896-a055-e51b21b814ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Flow 'volume_create_manager' (b00c13f9-a336-4e49-ae17-557f07fa28cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:44 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4b8fad44-5818-456f-bf36-67b4f83bd1bc tempest-VolumesCloneTest-1858278022 None] Created volume successfully. Nov 05 12:04:45 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.363s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:04:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Deleted volume successfully. Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31ea3805-46b0-4ff5-b7ef-849d6b3715bd tempest-VolumesActionsTest-1801966644 None] Lock "cinder-673d20ea-7108-43a1-b671-cd5c582aa234-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:45 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c" returned: 0 in 0.614s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:45 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c Nov 05 12:04:45 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:45 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6dd89066-29ef-4e5f-b906-22bc07802d9c" returned: 0 in 0.311s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-6dd89066-29ef-4e5f-b906-22bc07802d9c" released by "delete_volume" :: held 0.984s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Created reservations ['1ff6c688-0f85-41f9-b7dc-7d292c6fd1d5', 'a5a0e996-5ad5-427f-ad88-e26d7d7bf1ed', '8dabaf00-7e45-4b41-8ef0-d4bf8427b325', '532aec43-cfec-4c3c-b2a6-60a10993d7d8'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:45 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:04:45 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:45 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.324s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:04:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Deleted volume successfully. Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-74157cab-a3ed-42a3-8084-4717920fb8c3 req-c5e123c1-d5ff-4529-8636-b6217098a92a tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-74157cab-a3ed-42a3-8084-4717920fb8c3 req-c5e123c1-d5ff-4529-8636-b6217098a92a tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ddc5c9fb-2e50-46db-9a43-0ed99eb1c535 tempest-VolumesActionsTest-949967807 None] Lock "cinder-6dd89066-29ef-4e5f-b906-22bc07802d9c-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-74157cab-a3ed-42a3-8084-4717920fb8c3 req-c5e123c1-d5ff-4529-8636-b6217098a92a tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-74157cab-a3ed-42a3-8084-4717920fb8c3 req-c5e123c1-d5ff-4529-8636-b6217098a92a tempest-AttachVolumeTestJSON-1534323722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-d9722c0a-a4bc-474f-896b-5450cb84075b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f23dc5d-2148-4f5b-bf84-b8c336c425af', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:04:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-74157cab-a3ed-42a3-8084-4717920fb8c3 req-c5e123c1-d5ff-4529-8636-b6217098a92a tempest-AttachVolumeTestJSON-1534323722 None] attachment_update completed successfully. Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Flow 'volume_create_manager' (14a03840-c8b9-4017-bd91-ba1268e33738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcf839d-c357-4436-8996-c528db90379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcf839d-c357-4436-8996-c528db90379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1063643021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34483606ff334fb995b3016272f14e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=327fc56c-231c-4ab8-9939-66b91b0a72b2,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:47Z,use_quota=True,user_id='ddfbf860928d43278e4e9a2f41761243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3038cd89-2091-4191-84c9-448edc4df51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3038cd89-2091-4191-84c9-448edc4df51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010b48b-a274-4b30-b528-a95044526ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010b48b-a274-4b30-b528-a95044526ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b', 'volume_name': 'volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b', 'volume_size': 2, 'source_volid': '327fc56c-231c-4ab8-9939-66b91b0a72b2', 'source_volstatus': 'available'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4510bb-5a0c-4b07-befd-367a00bb8e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4510bb-5a0c-4b07-befd-367a00bb8e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ae7feb-8d48-4da4-a8fd-d305fcbfb3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Volume bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b', 'volume_size': 2, 'source_volid': '327fc56c-231c-4ab8-9939-66b91b0a72b2', 'source_volstatus': 'available'} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:46 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Cloning volume 327fc56c-231c-4ab8-9939-66b91b0a72b2 to volume bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Creating offline snapshot beefa2f8-f7f6-4c73-9a41-8944fd26d689 of volume 327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6437e259-7902-4e0b-8b88-c5608f3f76cd]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:47 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 Nov 05 12:04:47 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (b0f51602-9e06-4571-98b7-4260408fe795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef8c787-f36d-4342-b23e-05c348f92ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef8c787-f36d-4342-b23e-05c348f92ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1966797652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39940b8b-ee21-4c42-abef-bf390943078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:48Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:47 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68d2f5c-d846-4d26-8189-03e40228f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68d2f5c-d846-4d26-8189-03e40228f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac54c9f3-b945-4fb9-8106-af09310384c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac54c9f3-b945-4fb9-8106-af09310384c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39940b8b-ee21-4c42-abef-bf390943078f', 'volume_name': 'volume-39940b8b-ee21-4c42-abef-bf390943078f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ba2ca2-ac05-4e40-b50d-447203494f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ba2ca2-ac05-4e40-b50d-447203494f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5036ea-b16a-4bf9-ac79-3980633dc00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:04:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Volume 39940b8b-ee21-4c42-abef-bf390943078f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39940b8b-ee21-4c42-abef-bf390943078f', 'volume_size': 1} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2" returned: 0 in 0.642s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:47 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 1G Nov 05 12:04:47 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:48 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 1G" returned: 0 in 0.620s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:48 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 Nov 05 12:04:48 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:48 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689" returned: 0 in 0.384s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:48 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 is being set with open permissions: ugo+rw Nov 05 12:04:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:48 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 Nov 05 12:04:48 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:49 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689" returned: 0 in 0.273s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:49 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.info Nov 05 12:04:49 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:49 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.info" returned: 0 in 0.280s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:49 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.info is being set with open permissions: ugo+rw Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:49 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.info Nov 05 12:04:49 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:49 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.info" returned: 0 in 0.302s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "cinder-quobyte-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] snapshot: beefa2f8-f7f6-4c73-9a41-8944fd26d689, volume: bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[696737a7-a6fd-4d59-ab30-1e9551fa7733]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:49 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 Nov 05 12:04:49 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:50 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689" returned: 0 in 0.446s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327fc56c-231c-4ab8-9939-66b91b0a72b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c36a43-2e75-4a7f-8704-b54f87a626b0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:50 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 Nov 05 12:04:50 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:50 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2" returned: 0 in 0.558s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:04:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:50 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b Nov 05 12:04:50 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:04:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:04:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:04:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:04:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:04:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:04:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:04:52 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:04:52 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:04:53 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 05 12:04:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.721s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:04:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:04:53 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:04:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:04:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:04:59 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=51,cinder:SELECT=47,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:04:59 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=37,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:05:02 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" returned: 0 in 11.820s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:02 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2, size 1024.00 MB, duration 11.83 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:05:02 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Converted 1024.00 MB image at 86.59 MB/s Nov 05 12:05:02 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b is being set with open permissions: ugo+rw Nov 05 12:05:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:02 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b Nov 05 12:05:02 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:02 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" returned: 0 in 0.326s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" released by "_copy_volume_from_snapshot" :: held 13.273s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "cinder-quobyte-beefa2f8-f7f6-4c73-9a41-8944fd26d689" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-beefa2f8-f7f6-4c73-9a41-8944fd26d689" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Deleting offline snapshot beefa2f8-f7f6-4c73-9a41-8944fd26d689 of volume 327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] snapshot_file for this snap is: volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edc9233-6ccd-4bb9-8350-c94fea196363]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:03 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 Nov 05 12:05:03 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Flow 'volume_create_manager' (7ee878c0-e521-4d95-825f-6ab28f2e0e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f68a7c-1096-4a04-93d0-2495bbb740e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f68a7c-1096-4a04-93d0-2495bbb740e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-41745941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71b332bc11048dea98da219dee18c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:03Z,use_quota=True,user_id='5674954307644a3c983cbbb1bbd6d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9354f8d6-0d5d-49cb-955c-fa47faffda21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9354f8d6-0d5d-49cb-955c-fa47faffda21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6712051e-8368-4711-8103-6c6f926b2065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:05:03 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689" returned: 0 in 0.413s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327fc56c-231c-4ab8-9939-66b91b0a72b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae5fb3b-7f2a-4aa8-9cbe-008a7fa94942]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6712051e-8368-4711-8103-6c6f926b2065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3', 'volume_name': 'volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e27b09c-643f-4b7a-a204-7590c8b2dd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e27b09c-643f-4b7a-a204-7590c8b2dd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2995f6-0004-4b80-a22c-ee6e8e32489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:03 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 Nov 05 12:05:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Volume 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 12:05:03 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Trying to clone 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:05:04 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Image download 20.69 MB at 20.69 MB/s Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[054aea09-a3c3-4633-af49-1c0fee5f0ee2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:04 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2" returned: 0 in 0.714s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:04 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 Nov 05 12:05:04 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:04 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD Nov 05 12:05:04 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:04 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 is fetched for user 5674954307644a3c983cbbb1bbd6d983. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a80e901-9b9b-4d5b-a2d1-1dcf691e7373]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:04 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689" returned: 0 in 0.386s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:04 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689 Nov 05 12:05:04 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:04 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD Nov 05 12:05:04 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:05 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2.beefa2f8-f7f6-4c73-9a41-8944fd26d689" returned: 0 in 0.320s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:05 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-beefa2f8-f7f6-4c73-9a41-8944fd26d689" released by "_delete_snapshot" :: held 2.002s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.148s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.340s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1966797652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39940b8b-ee21-4c42-abef-bf390943078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:48Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Creating volume 39940b8b-ee21-4c42-abef-bf390943078f {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:05 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ae7feb-8d48-4da4-a8fd-d305fcbfb3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b', 'volume_size': 2, 'source_volid': '327fc56c-231c-4ab8-9939-66b91b0a72b2', 'source_volstatus': 'available'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:05 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f 1073741824 Nov 05 12:05:05 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415368d7-1fc8-4a7a-99da-40530ca1ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Volume volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b (bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b): created successfully Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415368d7-1fc8-4a7a-99da-40530ca1ae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Flow 'volume_create_manager' (14a03840-c8b9-4017-bd91-ba1268e33738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-73b168a1-2a1d-4852-b15d-8d12e16b6e28 tempest-VolumesCloneTest-1858278022 None] Created volume successfully. Nov 05 12:05:05 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f 1073741824" returned: 0 in 0.515s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:05 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f Nov 05 12:05:05 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:05 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f" returned: 0 in 0.256s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-41745941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71b332bc11048dea98da219dee18c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:03Z,use_quota=True,user_id='5674954307644a3c983cbbb1bbd6d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Creating volume 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:05 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5036ea-b16a-4bf9-ac79-3980633dc00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39940b8b-ee21-4c42-abef-bf390943078f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:06 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 1073741824 Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9497be-face-4457-ab6a-7ddcf54315b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:06 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:06 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Volume volume-39940b8b-ee21-4c42-abef-bf390943078f (39940b8b-ee21-4c42-abef-bf390943078f): created successfully Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9497be-face-4457-ab6a-7ddcf54315b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (b0f51602-9e06-4571-98b7-4260408fe795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-88faa6e9-0979-4e1b-bccb-095ad66c7d5d tempest-VolumesActionsTest-628530106 None] Created volume successfully. Nov 05 12:05:06 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 1073741824" returned: 0 in 0.591s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:06 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 Nov 05 12:05:06 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "cinder-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "cinder-quobyte-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc100cb-f5a3-4628-beac-af3401f588e7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:06 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b Nov 05 12:05:06 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:06 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Attempting download of 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a29b2b1-ad1e-416f-936f-09f4cfb22e05]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_wd961x6i {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:07 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_wd961x6i Nov 05 12:05:07 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:07 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" returned: 0 in 0.517s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:07 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b Nov 05 12:05:07 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-39940b8b-ee21-4c42-abef-bf390943078f-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Lock "cinder-39940b8b-ee21-4c42-abef-bf390943078f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-quobyte-39940b8b-ee21-4c42-abef-bf390943078f" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-39940b8b-ee21-4c42-abef-bf390943078f" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcffe7-41af-47b6-ae25-be5028f7e3f5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:07 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_wd961x6i" returned: 0 in 0.604s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_wd961x6i {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:07 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f Nov 05 12:05:07 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:07 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_wd961x6i Nov 05 12:05:07 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:07 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" returned: 0 in 0.549s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b" released by "delete_volume" :: held 1.141s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:07 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Created reservations ['1b6256f0-3502-48b0-9566-b41de1067f54', 'c755cf2f-1d8d-4efb-bda1-14c6166b49e4', '2346dcce-10d6-4781-aed1-2c380d872658', '28855a8f-5881-4a48-9b8f-639396bae105'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:08 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:08 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:08 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f" returned: 0 in 0.500s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:08 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f Nov 05 12:05:08 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:08 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_wd961x6i" returned: 1 in 0.523s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_wd961x6i' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b5a65-b6c1-48c2-807c-52a8e1d1aa63]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:08 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD Nov 05 12:05:08 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:08 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Deleted volume successfully. Nov 05 12:05:08 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2bb585d5-75be-4667-93ab-ff095bfa66e5 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-bd3e4d93-29a5-4a23-b32b-0b1a7ee5fa8b-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-39940b8b-ee21-4c42-abef-bf390943078f" returned: 0 in 0.396s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-39940b8b-ee21-4c42-abef-bf390943078f" released by "delete_volume" :: held 0.944s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Created reservations ['83d34a9e-af12-4519-ab59-64dbc6546e47', '143f15f4-5ed3-476f-aba2-740ec7e79c3b', 'c0d4b41f-2071-4c8b-9a98-af9a5edf48b6', '26110b1f-8ab8-4056-abc1-4a4f9625f0bb'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:08 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 was qcow2, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:08 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 Nov 05 12:05:08 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:08 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:08 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "cinder-327fc56c-231c-4ab8-9939-66b91b0a72b2-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:09 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.453s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-327fc56c-231c-4ab8-9939-66b91b0a72b2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Deleted volume successfully. Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b2b8530-23df-4edc-9842-c412177cc8ce tempest-VolumesActionsTest-949967807 None] Lock "cinder-39940b8b-ee21-4c42-abef-bf390943078f-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "cinder-quobyte-327fc56c-231c-4ab8-9939-66b91b0a72b2" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-327fc56c-231c-4ab8-9939-66b91b0a72b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f26b2-324d-4adf-9001-c615a7d8f3da]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:09 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 Nov 05 12:05:09 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:10 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2" returned: 0 in 0.580s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:10 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2 Nov 05 12:05:10 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:10 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-327fc56c-231c-4ab8-9939-66b91b0a72b2" returned: 0 in 0.430s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-quobyte-327fc56c-231c-4ab8-9939-66b91b0a72b2" released by "delete_volume" :: held 1.097s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Created reservations ['64f2b6da-a4e3-4dae-bf4b-7e5870ef6629', '6b639eac-1fc0-43f3-8847-742d0e33452a', 'd8a01bcf-16e5-48bd-9880-15ec163cd789', 'ed9b97a1-71b0-45d3-9e51-8a840f20c2a2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (d67cabd6-321a-4bd6-825c-dcf9845c39ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee0ef53-9cd3-4d6b-ac10-628ed52e434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee0ef53-9cd3-4d6b-ac10-628ed52e434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463142223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da769e8-6ca4-4029-aba5-8745f6228675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:11Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427481d6-6ab6-4d18-8199-b05d69f2e599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427481d6-6ab6-4d18-8199-b05d69f2e599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a02f60-60a4-425f-b777-8859209b62a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a02f60-60a4-425f-b777-8859209b62a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da769e8-6ca4-4029-aba5-8745f6228675', 'volume_name': 'volume-3da769e8-6ca4-4029-aba5-8745f6228675', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988a67ee-649c-437a-9dc2-ffa724ac2711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988a67ee-649c-437a-9dc2-ffa724ac2711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9e4012-5b6d-46e6-a27b-b1d15c19867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:10 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Volume 3da769e8-6ca4-4029-aba5-8745f6228675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da769e8-6ca4-4029-aba5-8745f6228675', 'volume_size': 1} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463142223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da769e8-6ca4-4029-aba5-8745f6228675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:11Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Creating volume 3da769e8-6ca4-4029-aba5-8745f6228675 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:10 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:10 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 1073741824 Nov 05 12:05:10 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:10 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:10 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:11 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.379s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Deleted volume successfully. Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d1d719f0-7427-41ed-8ef9-d25b178c9585 tempest-VolumesCloneTest-1858278022 None] Lock "cinder-327fc56c-231c-4ab8-9939-66b91b0a72b2-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:11 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" returned: 0 in 2.873s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_3_hojcjldevstack@QuobyteHD, size 112.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:05:11 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Converted 112.00 MB image at 38.97 MB/s Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:11 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 1073741824" returned: 0 in 0.817s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:11 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 1G Nov 05 12:05:11 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:11 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 Nov 05 12:05:11 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:12 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675" returned: 0 in 0.308s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9e4012-5b6d-46e6-a27b-b1d15c19867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da769e8-6ca4-4029-aba5-8745f6228675', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af86cc71-b8e3-4194-8cf7-d01aa37e8b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:12 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Volume volume-3da769e8-6ca4-4029-aba5-8745f6228675 (3da769e8-6ca4-4029-aba5-8745f6228675): created successfully Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af86cc71-b8e3-4194-8cf7-d01aa37e8b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (d67cabd6-321a-4bd6-825c-dcf9845c39ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:12 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5d443e4d-44f7-4cdb-a258-5bac3c00d44b tempest-VolumesActionsTest-628530106 None] Created volume successfully. Nov 05 12:05:12 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 1G" returned: 0 in 0.458s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Downloaded image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 for user 5674954307644a3c983cbbb1bbd6d983 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Marking volume 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Copying metadata from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 to 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Creating volume glance metadata for volume 3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 backed by image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2995f6-0004-4b80-a22c-ee6e8e32489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad6e492-e381-4e1d-a7a0-444a64455433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:12 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Volume volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 (3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3): created successfully Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad6e492-e381-4e1d-a7a0-444a64455433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Flow 'volume_create_manager' (7ee878c0-e521-4d95-825f-6ab28f2e0e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:12 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b2be80cd-f593-4068-be97-0e526b9f0e79 tempest-VolumesExtendTest-681352885 None] Created volume successfully. Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-3da769e8-6ca4-4029-aba5-8745f6228675-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Lock "cinder-3da769e8-6ca4-4029-aba5-8745f6228675-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Acquiring lock "cinder-quobyte-3da769e8-6ca4-4029-aba5-8745f6228675" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-3da769e8-6ca4-4029-aba5-8745f6228675" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[431cf9f6-cb96-4e3d-b38e-30b6bc818da2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:13 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 Nov 05 12:05:13 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d09b11-6037-4abf-a142-7c988a9d73ae]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:13 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 Nov 05 12:05:13 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:13 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675" returned: 0 in 0.485s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:13 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675 Nov 05 12:05:13 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:13 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" returned: 0 in 0.461s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 2G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:13 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3da769e8-6ca4-4029-aba5-8745f6228675" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Lock "cinder-quobyte-3da769e8-6ca4-4029-aba5-8745f6228675" released by "delete_volume" :: held 0.837s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 2G" returned: 0 in 0.159s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0db6f421-d38f-4d21-8fc2-9001bc9cd89a tempest-VolumesExtendTest-681352885 None] Extend volume completed successfully. Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Created reservations ['8ef4057a-4b95-4789-ace1-35b6c61b43b3', '8475b1b5-0773-4b56-b22b-bff5e9968e99', '1663fb97-a1cb-486b-ac0d-176435a0d3cb', '8cf001b0-c9f5-419f-845b-b2f311a53512'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:14 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:14 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:14 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.299s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Deleted volume successfully. Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79662255-feac-43d6-99a7-a76d38ebd037 tempest-VolumesActionsTest-949967807 None] Lock "cinder-3da769e8-6ca4-4029-aba5-8745f6228675-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (1fc54502-a92b-4214-8c2b-aebfa5b51bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dd21ca-6bce-4528-b26d-bfeb0b3c8712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dd21ca-6bce-4528-b26d-bfeb0b3c8712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1161038541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454be94e-d617-49a4-ade7-1f79d633b388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:15Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845a4a30-1750-4885-b6ea-2888554cd3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845a4a30-1750-4885-b6ea-2888554cd3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe51572b-3a1f-47a0-8c16-ae37bffc70e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe51572b-3a1f-47a0-8c16-ae37bffc70e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454be94e-d617-49a4-ade7-1f79d633b388', 'volume_name': 'volume-454be94e-d617-49a4-ade7-1f79d633b388', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bda17ad-88b3-4e77-a53e-bdb6a1005b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bda17ad-88b3-4e77-a53e-bdb6a1005b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa758c4-a09a-423c-9960-0626ab9146c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:15 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Volume 454be94e-d617-49a4-ade7-1f79d633b388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454be94e-d617-49a4-ade7-1f79d633b388', 'volume_size': 1} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1161038541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454be94e-d617-49a4-ade7-1f79d633b388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cd52f305104533aba5fcdb984ab616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:15Z,use_quota=True,user_id='bcf850d8462f46a2bccd6d220dd98717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Creating volume 454be94e-d617-49a4-ade7-1f79d633b388 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:15 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:15 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 1073741824 Nov 05 12:05:15 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Acquiring lock "cinder-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Acquiring lock "cinder-quobyte-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c3a46-d4e8-4a3c-b5e0-e927f6700b0c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:15 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 Nov 05 12:05:15 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:15 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 1073741824" returned: 0 in 0.557s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:15 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 Nov 05 12:05:15 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:15 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" returned: 0 in 0.455s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:15 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3 Nov 05 12:05:15 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:15 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388" returned: 0 in 0.304s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa758c4-a09a-423c-9960-0626ab9146c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454be94e-d617-49a4-ade7-1f79d633b388', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2f35c8-e485-4ccd-9ff0-fae0ad275faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:15 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Volume volume-454be94e-d617-49a4-ade7-1f79d633b388 (454be94e-d617-49a4-ade7-1f79d633b388): created successfully Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2f35c8-e485-4ccd-9ff0-fae0ad275faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Flow 'volume_create_manager' (1fc54502-a92b-4214-8c2b-aebfa5b51bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:16 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" returned: 0 in 0.300s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7738a748-e745-45bd-afe7-cd1dd507188e tempest-VolumesActionsTest-628530106 None] Created volume successfully. Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3" released by "delete_volume" :: held 0.807s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Created reservations ['e5606528-8aae-4eec-a336-c7c5a640495d', 'aa90523e-f1c3-4b84-b453-b2a326c0a102', 'd71957c0-6799-4282-8bcc-ef9a4c4d60ad', '46b0fae7-5bb9-41df-9313-8ec34435e586'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:16 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:16 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Flow 'volume_create_manager' (79841cb8-13ed-484b-a5f1-3fd05f34c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06575c85-040d-4c7a-8fe5-190295108be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06575c85-040d-4c7a-8fe5-190295108be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-922358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eadfac3-8034-409d-b628-32d3ede30d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5192394f9a4c4fb0807ccb1b21a7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:16Z,use_quota=True,user_id='6848638e8a864cfba49af5b6d70d3fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c9aba2-5ace-4bea-a5b4-1541469e1817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c9aba2-5ace-4bea-a5b4-1541469e1817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f7c92c-927e-443b-98f4-d5a70e2e9e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f7c92c-927e-443b-98f4-d5a70e2e9e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eadfac3-8034-409d-b628-32d3ede30d84', 'volume_name': 'volume-0eadfac3-8034-409d-b628-32d3ede30d84', 'volume_size': 2}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a564f4a3-1eeb-423a-b332-105c76fe90b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a564f4a3-1eeb-423a-b332-105c76fe90b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33691fec-eec7-464f-9091-c458c87cf2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Volume 0eadfac3-8034-409d-b628-32d3ede30d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eadfac3-8034-409d-b628-32d3ede30d84', 'volume_size': 2} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-922358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eadfac3-8034-409d-b628-32d3ede30d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5192394f9a4c4fb0807ccb1b21a7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:16Z,use_quota=True,user_id='6848638e8a864cfba49af5b6d70d3fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Creating volume 0eadfac3-8034-409d-b628-32d3ede30d84 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:16 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 2147483648 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:16 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.283s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:16 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 2147483648 Nov 05 12:05:16 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Deleted volume successfully. Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ab4aab1-f7d2-47a0-9bdc-a5095b3472a8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-3a0d2dc7-2ea3-4056-82c5-7ffe8a77f5c3-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Flow 'volume_create_manager' (612d51db-d8e3-484f-a89e-7e83d06e33d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe44940-96f2-4aaa-befb-68c50a3545d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe44940-96f2-4aaa-befb-68c50a3545d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1767282147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604be328-7d2a-4901-a32f-36001571ef00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71b332bc11048dea98da219dee18c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:17Z,use_quota=True,user_id='5674954307644a3c983cbbb1bbd6d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffc2331-3c09-4076-9965-dea8713a1a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffc2331-3c09-4076-9965-dea8713a1a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70f044-cd11-419b-b5d2-1c68d7fb6130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70f044-cd11-419b-b5d2-1c68d7fb6130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604be328-7d2a-4901-a32f-36001571ef00', 'volume_name': 'volume-604be328-7d2a-4901-a32f-36001571ef00', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bec566-d449-452d-bf0f-761baad1b99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bec566-d449-452d-bf0f-761baad1b99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d057714-384f-451d-b0d7-adb4273ad617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:16 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Volume 604be328-7d2a-4901-a32f-36001571ef00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604be328-7d2a-4901-a32f-36001571ef00', 'volume_size': 1} Nov 05 12:05:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:17 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 2147483648" returned: 0 in 0.678s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:17 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 Nov 05 12:05:17 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:17 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84" returned: 0 in 0.358s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1767282147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604be328-7d2a-4901-a32f-36001571ef00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71b332bc11048dea98da219dee18c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:17Z,use_quota=True,user_id='5674954307644a3c983cbbb1bbd6d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Creating volume 604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:17 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:17 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 1073741824 Nov 05 12:05:17 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33691fec-eec7-464f-9091-c458c87cf2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eadfac3-8034-409d-b628-32d3ede30d84', 'volume_size': 2}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814a6f60-7c87-4ac4-838b-cd50639b970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:17 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Volume volume-0eadfac3-8034-409d-b628-32d3ede30d84 (0eadfac3-8034-409d-b628-32d3ede30d84): created successfully Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814a6f60-7c87-4ac4-838b-cd50639b970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Flow 'volume_create_manager' (79841cb8-13ed-484b-a5f1-3fd05f34c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4198b4ea-ea28-4d64-ad41-a25c231de909 tempest-VolumesCloneNegativeTest-1512287188 None] Created volume successfully. Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Acquiring lock "cinder-454be94e-d617-49a4-ade7-1f79d633b388-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Lock "cinder-454be94e-d617-49a4-ade7-1f79d633b388-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Acquiring lock "cinder-quobyte-454be94e-d617-49a4-ade7-1f79d633b388" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Lock "cinder-quobyte-454be94e-d617-49a4-ade7-1f79d633b388" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6723ae9c-cc46-4ad3-bd0f-b90ae3eaa4f9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:18 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 Nov 05 12:05:18 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:18 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 1073741824" returned: 0 in 0.575s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:18 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 Nov 05 12:05:18 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:18 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388" returned: 0 in 0.516s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:18 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00" returned: 0 in 0.349s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:18 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388 Nov 05 12:05:18 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d057714-384f-451d-b0d7-adb4273ad617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604be328-7d2a-4901-a32f-36001571ef00', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a7a171-31d6-4dea-b482-66d604a9ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:18 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Volume volume-604be328-7d2a-4901-a32f-36001571ef00 (604be328-7d2a-4901-a32f-36001571ef00): created successfully Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a7a171-31d6-4dea-b482-66d604a9ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Flow 'volume_create_manager' (612d51db-d8e3-484f-a89e-7e83d06e33d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:18 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e40a3bb5-0127-4ab7-b93b-519101099c8c tempest-VolumesExtendTest-681352885 None] Created volume successfully. Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Acquiring lock "cinder-0eadfac3-8034-409d-b628-32d3ede30d84-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Lock "cinder-0eadfac3-8034-409d-b628-32d3ede30d84-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Acquiring lock "cinder-quobyte-0eadfac3-8034-409d-b628-32d3ede30d84" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Lock "cinder-quobyte-0eadfac3-8034-409d-b628-32d3ede30d84" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6289dec6-ff65-41d8-a817-2cd33484db9c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:18 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-454be94e-d617-49a4-ade7-1f79d633b388" returned: 0 in 0.436s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Lock "cinder-quobyte-454be94e-d617-49a4-ade7-1f79d633b388" released by "delete_volume" :: held 1.013s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:18 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 Nov 05 12:05:18 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Created reservations ['9fbe0945-314c-4240-8247-ebc4819de373', 'ef123270-9ba2-4a15-a0d6-96c36c611ed2', '317dd64d-488f-4f7f-a19d-ff7c7db80b62', '5106d15a-bf5f-4013-bb86-6b2a6b22bb42'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:19 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:19 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Creating offline snapshot 98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 of volume 604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e49995-6c99-4863-bb2c-5a5a45cc1087]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-932c75dd-3e41-4755-96df-a07889034ea8 req-7e82f136-2a11-44a5-95da-d4285ca4f58f tempest-AttachVolumeTestJSON-1534323722 None] Terminate volume connection completed successfully. Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-932c75dd-3e41-4755-96df-a07889034ea8 req-7e82f136-2a11-44a5-95da-d4285ca4f58f tempest-AttachVolumeTestJSON-1534323722 None] Deleting attachment 4f23dc5d-2148-4f5b-bf84-b8c336c425af. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:05:19 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84" returned: 0 in 0.564s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:19 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84 Nov 05 12:05:19 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:19 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 Nov 05 12:05:19 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:19 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.366s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Deleted volume successfully. Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5f80b17-0f9d-4b64-afc8-743c42c4524b tempest-VolumesActionsTest-628530106 None] Lock "cinder-454be94e-d617-49a4-ade7-1f79d633b388-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:19 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eadfac3-8034-409d-b628-32d3ede30d84" returned: 0 in 0.345s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Lock "cinder-quobyte-0eadfac3-8034-409d-b628-32d3ede30d84" released by "delete_volume" :: held 0.957s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:19 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00" returned: 0 in 0.489s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:19 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 1G Nov 05 12:05:19 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Created reservations ['58854806-48a1-4afa-bd2c-dc9bb833b7ab', 'd0303540-f77e-4d2a-998d-452092465f5c', '656892cd-5155-412f-bd64-6fadcde6bf0e', 'b6e8e978-5706-465d-8f4f-17630b3c4c1a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:19 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:19 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:20 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Deleted volume successfully. Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd296464-2e17-44fa-96a3-0c915c62ef9e tempest-VolumesCloneNegativeTest-1512287188 None] Lock "cinder-0eadfac3-8034-409d-b628-32d3ede30d84-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:20 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 1G" returned: 0 in 0.609s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604be328-7d2a-4901-a32f-36001571ef00 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:20 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604be328-7d2a-4901-a32f-36001571ef00 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 Nov 05 12:05:20 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:20 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604be328-7d2a-4901-a32f-36001571ef00 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" returned: 0 in 0.301s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:20 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 is being set with open permissions: ugo+rw Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:20 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 Nov 05 12:05:20 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:20 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" returned: 0 in 0.293s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:21 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.info Nov 05 12:05:21 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:21 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.info" returned: 0 in 0.341s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:21 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.info is being set with open permissions: ugo+rw Nov 05 12:05:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:21 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.info Nov 05 12:05:21 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:21 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.info" returned: 0 in 0.338s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:21 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-da2c0bb5-262e-4ae0-b469-cbd001078065 tempest-VolumesExtendTest-681352885 None] Create snapshot completed successfully Nov 05 12:05:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6264ab71-dc57-4f10-997c-93265bdfbeea]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:22 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 Nov 05 12:05:22 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:23 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00" returned: 0 in 0.486s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 2G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 2G" returned: 0 in 0.215s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.767s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:23 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-410b60a3-b8c7-47c8-b92b-434b29ff3897 tempest-VolumesExtendTest-681352885 None] Extend volume completed successfully. Nov 05 12:05:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Acquiring lock "cinder-98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Lock "cinder-98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Acquiring lock "cinder-quobyte-604be328-7d2a-4901-a32f-36001571ef00" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-604be328-7d2a-4901-a32f-36001571ef00" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Acquiring lock "cinder-quobyte-98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Deleting offline snapshot 98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 of volume 604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] snapshot_file for this snap is: volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638d633-2020-41d3-ba3e-f3af40e6b755]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:24 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 Nov 05 12:05:24 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:24 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" returned: 0 in 0.583s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-604be328-7d2a-4901-a32f-36001571ef00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffdf4c3-929d-44a8-a87d-5ef78c6e6431]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:25 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 Nov 05 12:05:25 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:25 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00" returned: 0 in 0.719s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:25 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 Nov 05 12:05:25 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:26 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" returned: 0 in 0.827s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:26 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4 Nov 05 12:05:26 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:27 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00.98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" returned: 0 in 0.643s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4" released by "_delete_snapshot" :: held 3.025s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-604be328-7d2a-4901-a32f-36001571ef00" released by "delete_snapshot" :: held 3.078s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:27 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Created reservations ['72d86cb7-babd-4940-b24a-7cf924c5e5d2', '8163077a-ced2-4e0c-aea1-32556d8ba035', 'c42874ca-e1fa-466e-b2aa-9d7c8fd99231', '754d06a9-0b20-4b93-b4cd-d3607bd926ff'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Delete snapshot completed successfully. Nov 05 12:05:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec4d31d3-f607-4109-9d8a-6ee080983341 tempest-VolumesExtendTest-681352885 None] Lock "cinder-98f0dc52-abe5-4ac8-9f9f-a9bb7e5a92d4-delete_snapshot" released by "delete_snapshot" :: held 3.459s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Acquiring lock "cinder-604be328-7d2a-4901-a32f-36001571ef00-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-604be328-7d2a-4901-a32f-36001571ef00-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Acquiring lock "cinder-quobyte-604be328-7d2a-4901-a32f-36001571ef00" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-604be328-7d2a-4901-a32f-36001571ef00" acquired by "delete_volume" :: waited 0.047s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efc95e5-2c83-4d56-935b-563b42295341]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:29 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 Nov 05 12:05:29 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:29 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00" returned: 0 in 0.724s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:29 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00 Nov 05 12:05:29 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:30 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-604be328-7d2a-4901-a32f-36001571ef00" returned: 0 in 0.400s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-quobyte-604be328-7d2a-4901-a32f-36001571ef00" released by "delete_volume" :: held 1.296s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Created reservations ['3d7f28fc-f983-40b9-8485-a6c86e9aac7d', 'b1bb4d9b-5dcb-4e20-8b3b-a1108a5e48bb', 'af6ef537-be66-4506-b38b-10a5f2dea1a2', '99c82e17-0426-475e-85ea-f350005ceb5e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:30 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:30 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:30 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.377s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Deleted volume successfully. Nov 05 12:05:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e0170da3-2a52-4dee-8c8c-dfc5ef9840f8 tempest-VolumesExtendTest-681352885 None] Lock "cinder-604be328-7d2a-4901-a32f-36001571ef00-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Flow 'volume_create_manager' (7538d96c-dabe-4a44-a4d8-66c06b9e1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34e3800-2991-4f2a-9a93-b2dee1460c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34e3800-2991-4f2a-9a93-b2dee1460c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1375215316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a1c3f2-de42-4189-843e-0e1af5b845b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1888e1a6092416cb40b992bc6788b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:33Z,use_quota=True,user_id='1244a9f60b6b49b3afe9438dcc7f5da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddd2811-82c6-4e37-944d-4ed9f29052bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddd2811-82c6-4e37-944d-4ed9f29052bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021b2d1b-ac3a-42fe-9f7a-c1b8357fe214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021b2d1b-ac3a-42fe-9f7a-c1b8357fe214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a1c3f2-de42-4189-843e-0e1af5b845b9', 'volume_name': 'volume-96a1c3f2-de42-4189-843e-0e1af5b845b9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f90440e-3710-40f5-8486-4e8dcbefd94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f90440e-3710-40f5-8486-4e8dcbefd94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2552e5f-9cf8-453b-a804-1e430e78e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Volume 96a1c3f2-de42-4189-843e-0e1af5b845b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a1c3f2-de42-4189-843e-0e1af5b845b9', 'volume_size': 1} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1375215316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a1c3f2-de42-4189-843e-0e1af5b845b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1888e1a6092416cb40b992bc6788b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:33Z,use_quota=True,user_id='1244a9f60b6b49b3afe9438dcc7f5da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Creating volume 96a1c3f2-de42-4189-843e-0e1af5b845b9 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:33 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:33 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 1073741824 Nov 05 12:05:33 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:33 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 1073741824" returned: 0 in 0.657s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:34 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 Nov 05 12:05:34 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:34 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9" returned: 0 in 0.472s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2552e5f-9cf8-453b-a804-1e430e78e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a1c3f2-de42-4189-843e-0e1af5b845b9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3f14c4-fb15-4662-b5c5-b6a6fa2e41b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:34 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Volume volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 (96a1c3f2-de42-4189-843e-0e1af5b845b9): created successfully Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3f14c4-fb15-4662-b5c5-b6a6fa2e41b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Flow 'volume_create_manager' (7538d96c-dabe-4a44-a4d8-66c06b9e1037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5e342601-4a2f-48fc-b680-034d3fdffc72 tempest-VolumesNegativeTest-1441896846 None] Created volume successfully. Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Flow 'volume_create_manager' (81ec6e55-4e03-4129-80da-da8a93859f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1ba0dc-8b38-4fc7-81b4-ac4d21e9ede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1ba0dc-8b38-4fc7-81b4-ac4d21e9ede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-990906532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e33c0a-4c60-4310-93a9-65bb1faf9069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e79142ca84848baaf8ea58145961e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:37Z,use_quota=True,user_id='b1b5137aaa0d4cf892dcd999615da98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31674cb-24cd-4eb3-b723-aacf3d198679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31674cb-24cd-4eb3-b723-aacf3d198679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6040f18b-a361-411c-8870-f416230e53d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6040f18b-a361-411c-8870-f416230e53d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e33c0a-4c60-4310-93a9-65bb1faf9069', 'volume_name': 'volume-84e33c0a-4c60-4310-93a9-65bb1faf9069', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd441775-d1a5-4a4a-befc-8379789fce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd441775-d1a5-4a4a-befc-8379789fce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6d14c4-72ef-4916-86b8-aa56f6dfa32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:37 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Volume 84e33c0a-4c60-4310-93a9-65bb1faf9069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e33c0a-4c60-4310-93a9-65bb1faf9069', 'volume_size': 1} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-990906532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e33c0a-4c60-4310-93a9-65bb1faf9069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e79142ca84848baaf8ea58145961e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:37Z,use_quota=True,user_id='b1b5137aaa0d4cf892dcd999615da98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Creating volume 84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:37 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:37 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 1073741824 Nov 05 12:05:37 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:38 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 1073741824" returned: 0 in 0.757s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:38 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 Nov 05 12:05:38 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:39 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069" returned: 0 in 0.780s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6d14c4-72ef-4916-86b8-aa56f6dfa32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e33c0a-4c60-4310-93a9-65bb1faf9069', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d8a0a9-9f37-403b-a936-4f350ffa6e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:39 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Volume volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 (84e33c0a-4c60-4310-93a9-65bb1faf9069): created successfully Nov 05 12:05:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d8a0a9-9f37-403b-a936-4f350ffa6e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Flow 'volume_create_manager' (81ec6e55-4e03-4129-80da-da8a93859f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:39 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-95619b3f-66fb-431a-b441-e5a4e10fbdbc tempest-VolumesSnapshotListTestJSON-131182171 None] Created volume successfully. Nov 05 12:05:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Creating offline snapshot 4c3987bc-6446-4d19-94ac-9a46a13128ae of volume 84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:05:40 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f76f00-4913-4466-a509-bf7a7ea345b9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:40 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 Nov 05 12:05:40 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:40 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069" returned: 0 in 0.516s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:40 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae 1G Nov 05 12:05:40 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:41 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae 1G" returned: 0 in 0.607s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:41 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae Nov 05 12:05:41 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:41 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae" returned: 0 in 0.393s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:41 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae is being set with open permissions: ugo+rw Nov 05 12:05:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:41 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae Nov 05 12:05:41 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:41 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:41 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.info Nov 05 12:05:41 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:42 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.info" returned: 0 in 0.336s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:42 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.info is being set with open permissions: ugo+rw Nov 05 12:05:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:42 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.info Nov 05 12:05:42 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:42 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.info" returned: 0 in 0.336s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8ac72ebe-53cf-480d-872d-39d8b6e71e6b tempest-VolumesSnapshotListTestJSON-131182171 None] Create snapshot completed successfully Nov 05 12:05:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Creating offline snapshot c058e009-b1e9-42e1-acc4-11292240ac5c of volume 84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:05:43 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4f2bb-57db-43b3-bcdc-c34d3dbca64f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:44 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae Nov 05 12:05:44 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:44 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae" returned: 0 in 0.870s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e33c0a-4c60-4310-93a9-65bb1faf9069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:44 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c 1G Nov 05 12:05:44 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:45 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c 1G" returned: 0 in 0.993s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:45 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c Nov 05 12:05:45 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:46 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c" returned: 0 in 0.856s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:46 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c is being set with open permissions: ugo+rw Nov 05 12:05:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:46 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c Nov 05 12:05:46 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:47 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.399s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2653c5d0-175b-4b26-81c7-9994b9a0da22 tempest-VolumesSnapshotListTestJSON-131182171 None] Create snapshot completed successfully Nov 05 12:05:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Creating offline snapshot 19c200d8-6f2e-4b3f-ba18-67f9a6576282 of volume 84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:05:48 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a65fa4-d21d-4929-88d4-4a6d03e16e00]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:49 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c Nov 05 12:05:49 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:49 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c" returned: 0 in 1.000s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e33c0a-4c60-4310-93a9-65bb1faf9069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:49 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 1G Nov 05 12:05:49 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Flow 'volume_create_manager' (6e4d36c0-7d28-4873-8850-a0ac66b47611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be04b6f-6d89-4a94-aaed-cd21ca7abfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be04b6f-6d89-4a94-aaed-cd21ca7abfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-796867950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3159f5b7-0506-421d-99c8-8771067302fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac9fcf8316c4ba5b8e419117fabfee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:50Z,use_quota=True,user_id='a5ca9458a7544dfea9ea75002bb2e3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c4df58-419b-497f-9114-089c3b6825dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c4df58-419b-497f-9114-089c3b6825dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c4a40a-010e-409a-b9ec-9d79d0fd78d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c4a40a-010e-409a-b9ec-9d79d0fd78d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3159f5b7-0506-421d-99c8-8771067302fc', 'volume_name': 'volume-3159f5b7-0506-421d-99c8-8771067302fc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c6d845-c033-4910-96fe-38191cb9bf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c6d845-c033-4910-96fe-38191cb9bf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecaccbf-db16-405b-937f-9ce972a55cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:50 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Volume 3159f5b7-0506-421d-99c8-8771067302fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3159f5b7-0506-421d-99c8-8771067302fc', 'volume_size': 1} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:50 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 1G" returned: 0 in 0.986s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:50 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 Nov 05 12:05:50 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:51 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282" returned: 0 in 0.492s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:51 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 is being set with open permissions: ugo+rw Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:51 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 Nov 05 12:05:51 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:51 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282" returned: 0 in 0.359s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.130s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.097s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-796867950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3159f5b7-0506-421d-99c8-8771067302fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac9fcf8316c4ba5b8e419117fabfee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:50Z,use_quota=True,user_id='a5ca9458a7544dfea9ea75002bb2e3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Creating volume 3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:05:51 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:05:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:51 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc 1073741824 Nov 05 12:05:51 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-838eec37-3091-4d9d-a17d-22746250a743 tempest-VolumesSnapshotListTestJSON-131182171 None] Create snapshot completed successfully Nov 05 12:05:52 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc 1073741824" returned: 0 in 0.652s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:52 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc Nov 05 12:05:52 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:52 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:05:52 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:52 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc" returned: 0 in 0.341s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecaccbf-db16-405b-937f-9ce972a55cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3159f5b7-0506-421d-99c8-8771067302fc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:52 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0a7a6-193e-4f97-a7aa-1d84d39d4f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.321s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:05:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Volume volume-3159f5b7-0506-421d-99c8-8771067302fc (3159f5b7-0506-421d-99c8-8771067302fc): created successfully Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0a7a6-193e-4f97-a7aa-1d84d39d4f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:05:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Flow 'volume_create_manager' (6e4d36c0-7d28-4873-8850-a0ac66b47611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:05:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0cac62b5-d37a-4962-939c-9d44179f410d tempest-VolumesDeleteCascade-617797462 None] Created volume successfully. Nov 05 12:05:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Creating offline snapshot 5fe984d4-0124-4951-a35f-5e6599db379b of volume 3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:05:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1125eff1-65ee-40fa-996e-3bb57b5fb272]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:53 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc Nov 05 12:05:53 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-19c200d8-6f2e-4b3f-ba18-67f9a6576282-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-19c200d8-6f2e-4b3f-ba18-67f9a6576282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:54 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc" returned: 0 in 0.529s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-quobyte-19c200d8-6f2e-4b3f-ba18-67f9a6576282" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:54 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b 1G Nov 05 12:05:54 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-19c200d8-6f2e-4b3f-ba18-67f9a6576282" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Deleting offline snapshot 19c200d8-6f2e-4b3f-ba18-67f9a6576282 of volume 84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] snapshot_file for this snap is: volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5745573-a7db-40e9-b7b3-10da6a4dfad6]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:54 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 Nov 05 12:05:54 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:54 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282" returned: 0 in 0.483s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e33c0a-4c60-4310-93a9-65bb1faf9069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:54 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b 1G" returned: 0 in 0.638s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba89172f-446f-43e1-b80a-39528670ed06]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:55 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b Nov 05 12:05:55 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:55 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c Nov 05 12:05:55 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:55 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b" returned: 0 in 0.481s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:55 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b is being set with open permissions: ugo+rw Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:55 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b Nov 05 12:05:55 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:55 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c" returned: 0 in 0.556s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e33c0a-4c60-4310-93a9-65bb1faf9069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:55 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 Nov 05 12:05:55 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:55 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b" returned: 0 in 0.323s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:55 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.info Nov 05 12:05:55 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:56 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282" returned: 0 in 0.567s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:56 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282 Nov 05 12:05:56 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:56 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.info" returned: 0 in 0.352s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:56 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.info is being set with open permissions: ugo+rw Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:56 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.info Nov 05 12:05:56 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:56 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.19c200d8-6f2e-4b3f-ba18-67f9a6576282" returned: 0 in 0.339s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-19c200d8-6f2e-4b3f-ba18-67f9a6576282" released by "_delete_snapshot" :: held 2.108s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:56 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" released by "delete_snapshot" :: held 2.153s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.info" returned: 0 in 0.339s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.873s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:56 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a430ede0-885d-4d0b-bb28-6b2121d551dc tempest-VolumesDeleteCascade-617797462 None] Create snapshot completed successfully Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Created reservations ['5b28ff79-457e-436e-9bf2-bd528c435c5f', 'db7bb672-27ed-43a0-8eb3-21c8042f13ec', 'dde865f5-5d30-45dd-9a36-4711c82a5c80', '50d18231-6973-4d73-8ecc-514496cf5a44'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:56 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Delete snapshot completed successfully. Nov 05 12:05:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37d6cd84-cca0-4883-88a5-69b03f6c30a5 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-19c200d8-6f2e-4b3f-ba18-67f9a6576282-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Creating offline snapshot 81b69441-bd56-41ac-98ea-f5dd6aa02e7c of volume 3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85792d9-10e6-4c23-8e60-45ccf3272ae1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:57 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b Nov 05 12:05:57 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-c058e009-b1e9-42e1-acc4-11292240ac5c-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-c058e009-b1e9-42e1-acc4-11292240ac5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-quobyte-c058e009-b1e9-42e1-acc4-11292240ac5c" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-c058e009-b1e9-42e1-acc4-11292240ac5c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Deleting offline snapshot c058e009-b1e9-42e1-acc4-11292240ac5c of volume 84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] snapshot_file for this snap is: volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:05:57 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b" returned: 0 in 0.532s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3159f5b7-0506-421d-99c8-8771067302fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[023950be-420f-42af-b4ca-592b2cd7f57b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:57 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c 1G Nov 05 12:05:57 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:57 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c Nov 05 12:05:57 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:58 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c" returned: 0 in 0.492s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e33c0a-4c60-4310-93a9-65bb1faf9069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f0296f-fce7-40df-9187-ae086e699591]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:58 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c 1G" returned: 0 in 0.651s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:58 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae Nov 05 12:05:58 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:58 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c Nov 05 12:05:58 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:58 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae" returned: 0 in 0.449s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e33c0a-4c60-4310-93a9-65bb1faf9069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:58 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c" returned: 0 in 0.372s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:58 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c is being set with open permissions: ugo+rw Nov 05 12:05:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:58 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c Nov 05 12:05:58 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:58 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c Nov 05 12:05:58 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:59 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c" returned: 0 in 0.343s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=115,cinder:SELECT=103,cinder:DELETE=11,cinder:INSERT=29 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:05:59 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f947ee9a-e840-446d-aee3-5c1cbdecde42 tempest-VolumesDeleteCascade-617797462 None] Create snapshot completed successfully Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=124,cinder:SELECT=93,cinder:INSERT=37,cinder:DELETE=13 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:05:59 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c" returned: 0 in 0.632s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:05:59 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c Nov 05 12:05:59 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:05:59 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.c058e009-b1e9-42e1-acc4-11292240ac5c" returned: 0 in 0.283s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-c058e009-b1e9-42e1-acc4-11292240ac5c" released by "_delete_snapshot" :: held 1.998s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" released by "delete_snapshot" :: held 2.029s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Created reservations ['04657098-ecc7-4c8c-b584-efa49f33e275', 'f10884aa-b359-43e8-ba1e-e28b52a04d6e', 'dabb0083-bb69-4a73-bef2-fdbd0bb59990', '2d9bf9ea-6ac3-4b40-969f-329bcdbc3445'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:05:59 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Delete snapshot completed successfully. Nov 05 12:05:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b5bf0715-2bc3-4def-b963-fafd7c9514cd tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-c058e009-b1e9-42e1-acc4-11292240ac5c-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-3159f5b7-0506-421d-99c8-8771067302fc-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-3159f5b7-0506-421d-99c8-8771067302fc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Performing cascade delete. {{(pid=86942) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-5fe984d4-0124-4951-a35f-5e6599db379b-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-5fe984d4-0124-4951-a35f-5e6599db379b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-5fe984d4-0124-4951-a35f-5e6599db379b" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-5fe984d4-0124-4951-a35f-5e6599db379b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Deleting offline snapshot 5fe984d4-0124-4951-a35f-5e6599db379b of volume 3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] snapshot_file for this snap is: volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6860b9e5-11f6-448e-b60c-2cffd691f73f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:00 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b Nov 05 12:06:00 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-4c3987bc-6446-4d19-94ac-9a46a13128ae-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-4c3987bc-6446-4d19-94ac-9a46a13128ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-quobyte-4c3987bc-6446-4d19-94ac-9a46a13128ae" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-4c3987bc-6446-4d19-94ac-9a46a13128ae" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Deleting offline snapshot 4c3987bc-6446-4d19-94ac-9a46a13128ae of volume 84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] snapshot_file for this snap is: volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db56a1a-15ad-4a02-a880-4f8670ec7dff]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:01 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b" returned: 0 in 0.580s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3159f5b7-0506-421d-99c8-8771067302fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa35d2a-5f4d-457c-ae55-3befd2ba4dca]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:01 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae Nov 05 12:06:01 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:01 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc Nov 05 12:06:01 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:01 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae" returned: 0 in 0.733s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e33c0a-4c60-4310-93a9-65bb1faf9069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce02fffa-2d61-497c-a600-887527530eda]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:01 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc" returned: 0 in 0.723s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f998d-1264-4081-b15b-9739d27d0e57]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:02 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 Nov 05 12:06:02 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:02 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c Nov 05 12:06:02 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:02 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069" returned: 0 in 0.556s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:02 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae Nov 05 12:06:02 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:02 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c" returned: 0 in 0.538s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3159f5b7-0506-421d-99c8-8771067302fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[709badef-2a5c-4839-9147-c76ba31057ff]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Acquiring lock "cinder-96a1c3f2-de42-4189-843e-0e1af5b845b9-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Lock "cinder-96a1c3f2-de42-4189-843e-0e1af5b845b9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Acquiring lock "cinder-quobyte-96a1c3f2-de42-4189-843e-0e1af5b845b9" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Lock "cinder-quobyte-96a1c3f2-de42-4189-843e-0e1af5b845b9" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:02 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b Nov 05 12:06:02 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[626c8131-fe07-4a7d-bff0-96eb2f316c35]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:02 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 Nov 05 12:06:02 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:03 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae" returned: 0 in 0.505s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:03 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae Nov 05 12:06:03 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:03 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b" returned: 0 in 0.515s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3159f5b7-0506-421d-99c8-8771067302fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7445f4f-4de0-4053-ad8d-c8bbfbaa5c55]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:03 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069.4c3987bc-6446-4d19-94ac-9a46a13128ae" returned: 0 in 0.363s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:03 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc Nov 05 12:06:03 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:03 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9" returned: 0 in 0.622s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-4c3987bc-6446-4d19-94ac-9a46a13128ae" released by "_delete_snapshot" :: held 2.436s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:03 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9 Nov 05 12:06:03 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" released by "delete_snapshot" :: held 2.485s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Created reservations ['011e713e-dcea-408f-b710-db816bc804dc', '52306053-d84a-4520-a38d-fafb767a4976', '0d8eecfc-34fe-4787-a058-cfaa7d7da02b', 'd4a7b7d1-5fe5-40c8-be23-41402dfad70b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:03 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Delete snapshot completed successfully. Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06a9567-7733-4f02-9262-8e340c220751 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-4c3987bc-6446-4d19-94ac-9a46a13128ae-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:03 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-96a1c3f2-de42-4189-843e-0e1af5b845b9" returned: 0 in 0.414s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Lock "cinder-quobyte-96a1c3f2-de42-4189-843e-0e1af5b845b9" released by "delete_volume" :: held 1.097s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:03 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc" returned: 0 in 0.714s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:03 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b Nov 05 12:06:03 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:03 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Created reservations ['6dbda276-ca92-488c-aab9-a9a85ebb317d', '15fe20dc-f4b6-4124-8003-620743898e4b', 'a4877c74-0ce7-4faa-a684-b68f75490029', 'ea27d063-8302-49b4-a54d-31757ead6b5c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:04 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:06:04 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-84e33c0a-4c60-4310-93a9-65bb1faf9069-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-84e33c0a-4c60-4310-93a9-65bb1faf9069-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" acquired by "delete_volume" :: waited 0.046s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:04 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:04 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.539s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b" returned: 0 in 0.700s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Deleted volume successfully. Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d64469-a2b3-438e-ad62-ba5bfcd71b4b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:04 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b Nov 05 12:06:04 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1c6ab867-288b-4521-9179-0807619bedcf tempest-VolumesNegativeTest-1441896846 None] Lock "cinder-96a1c3f2-de42-4189-843e-0e1af5b845b9-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:04 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 Nov 05 12:06:04 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:05 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.5fe984d4-0124-4951-a35f-5e6599db379b" returned: 0 in 0.569s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c -F qcow2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:05 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c -F qcow2 Nov 05 12:06:05 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:05 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069" returned: 0 in 0.903s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:05 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069 Nov 05 12:06:05 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:06 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3159f5b7-0506-421d-99c8-8771067302fc /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c -F qcow2" returned: 0 in 0.880s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-5fe984d4-0124-4951-a35f-5e6599db379b" released by "_delete_snapshot" :: held 5.586s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" released by "delete_snapshot" :: held 5.636s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:06 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84e33c0a-4c60-4310-93a9-65bb1faf9069" returned: 0 in 0.778s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Created reservations ['0cf7515a-57f2-455e-b92b-60ef79fb1a4b', '969c2793-dd5d-48d7-a124-043c2b3d55f9', 'e25a1e87-e236-42f2-80c3-0fbce622905e', 'dd6954cc-3d99-4fd5-bc03-7be2a93737b1'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-quobyte-84e33c0a-4c60-4310-93a9-65bb1faf9069" released by "delete_volume" :: held 1.945s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Delete snapshot completed successfully. Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-5fe984d4-0124-4951-a35f-5e6599db379b-delete_snapshot" released by "delete_snapshot" :: held 6.030s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-81b69441-bd56-41ac-98ea-f5dd6aa02e7c-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Created reservations ['2a9e0998-b780-4ca8-a57b-845173b7a02e', 'cde3f7e1-aeba-429c-9cfd-6d70b09c4a6d', '29886812-95aa-4014-8b08-d5b4807d9d45', '05561fdf-ff2a-4a10-8787-9ab2cddf22b8'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-81b69441-bd56-41ac-98ea-f5dd6aa02e7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-81b69441-bd56-41ac-98ea-f5dd6aa02e7c" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-81b69441-bd56-41ac-98ea-f5dd6aa02e7c" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Deleting offline snapshot 81b69441-bd56-41ac-98ea-f5dd6aa02e7c of volume 3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] snapshot_file for this snap is: volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ee992-a8bd-48c5-be5c-faebf072a2eb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:06 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:06:06 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:07 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c Nov 05 12:06:07 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:07 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.535s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:07 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:06:07 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Deleted volume successfully. Nov 05 12:06:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-848c22ce-3ed5-45df-bba9-91c99bcb0276 tempest-VolumesSnapshotListTestJSON-131182171 None] Lock "cinder-84e33c0a-4c60-4310-93a9-65bb1faf9069-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:07 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c" returned: 0 in 0.776s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3159f5b7-0506-421d-99c8-8771067302fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:06:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[888cfefe-354b-429d-af13-738c7361ef4f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:07 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc Nov 05 12:06:07 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:08 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc" returned: 0 in 0.517s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:08 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c Nov 05 12:06:08 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:08 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c" returned: 0 in 0.788s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:08 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c Nov 05 12:06:08 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:09 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc.81b69441-bd56-41ac-98ea-f5dd6aa02e7c" returned: 0 in 0.456s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-81b69441-bd56-41ac-98ea-f5dd6aa02e7c" released by "_delete_snapshot" :: held 2.724s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" released by "delete_snapshot" :: held 2.795s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Created reservations ['7656756a-c75e-4723-b1b0-b1510ca583c6', '205ad561-3582-4522-a117-a491e7411333', 'd89c3637-3446-407d-a3b0-33845082ebfb', '26d1b763-871f-4000-8fd3-5a47326a9c5b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Delete snapshot completed successfully. Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-81b69441-bd56-41ac-98ea-f5dd6aa02e7c-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Snapshots deleted, issuing volume delete {{(pid=86942) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" acquired by "delete_volume" :: waited 0.051s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ade2ff6-5369-45f2-a711-eae5aa7a3d8a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:10 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc Nov 05 12:06:10 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:10 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc" returned: 0 in 0.654s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:10 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc Nov 05 12:06:10 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:10 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3159f5b7-0506-421d-99c8-8771067302fc" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-3159f5b7-0506-421d-99c8-8771067302fc" released by "delete_volume" :: held 1.215s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Created reservations ['20ddde59-b4e2-4a52-aa44-e50a26093569', 'e981a5d9-3054-48d7-b2bd-caf0d94da833', 'ae54c98d-d91b-4acd-9bf0-144d392b6333', '6cca174f-cd8a-45da-a64d-043e803deab1'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:11 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:06:11 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:11 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.328s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:06:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Deleted volume successfully. Nov 05 12:06:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7dc57f1f-9410-4188-9ffa-39b3cbd91f19 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-3159f5b7-0506-421d-99c8-8771067302fc-delete_volume" released by "delete_volume" :: held 11.172s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Flow 'volume_create_manager' (e25bad6d-093b-46a7-81b9-806ff77a7663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7dd670-0f3f-497d-996b-152653cbb3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7dd670-0f3f-497d-996b-152653cbb3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-64323212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bc3190-f5b4-44ef-8114-b0464a08a450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac9fcf8316c4ba5b8e419117fabfee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='a5ca9458a7544dfea9ea75002bb2e3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068169f9-63e4-4755-a81d-f0e609bf242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068169f9-63e4-4755-a81d-f0e609bf242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff47beb-4e18-4873-8b4a-e6bb6b7f835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff47beb-4e18-4873-8b4a-e6bb6b7f835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82bc3190-f5b4-44ef-8114-b0464a08a450', 'volume_name': 'volume-82bc3190-f5b4-44ef-8114-b0464a08a450', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b179cf67-3535-47b7-8672-3aa27f980f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b179cf67-3535-47b7-8672-3aa27f980f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f15256a-59ea-4a71-8b6e-8ed56ad5367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Volume 82bc3190-f5b4-44ef-8114-b0464a08a450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82bc3190-f5b4-44ef-8114-b0464a08a450', 'volume_size': 1} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-64323212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bc3190-f5b4-44ef-8114-b0464a08a450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac9fcf8316c4ba5b8e419117fabfee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='a5ca9458a7544dfea9ea75002bb2e3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Creating volume 82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:06:13 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:06:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:13 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 1073741824 Nov 05 12:06:13 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:14 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 1073741824" returned: 0 in 0.653s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:14 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 Nov 05 12:06:14 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:14 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450" returned: 0 in 0.324s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f15256a-59ea-4a71-8b6e-8ed56ad5367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bc3190-f5b4-44ef-8114-b0464a08a450', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38fe9ea-1547-44d4-b34e-3ba715f2e317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:14 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Volume volume-82bc3190-f5b4-44ef-8114-b0464a08a450 (82bc3190-f5b4-44ef-8114-b0464a08a450): created successfully Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38fe9ea-1547-44d4-b34e-3ba715f2e317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Flow 'volume_create_manager' (e25bad6d-093b-46a7-81b9-806ff77a7663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f053b175-4ecd-42e5-8212-5905b82160bf tempest-VolumesDeleteCascade-617797462 None] Created volume successfully. Nov 05 12:06:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Creating offline snapshot a6b8a492-7569-43f3-ba39-c221c70e0107 of volume 82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:06:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[80410331-2e64-4331-af4a-871ecbb6835b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:16 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 Nov 05 12:06:16 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:16 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450" returned: 0 in 0.528s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:16 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 1G Nov 05 12:06:16 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:17 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 1G" returned: 0 in 0.703s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bc3190-f5b4-44ef-8114-b0464a08a450 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:17 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bc3190-f5b4-44ef-8114-b0464a08a450 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 Nov 05 12:06:17 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:17 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bc3190-f5b4-44ef-8114-b0464a08a450 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107" returned: 0 in 0.451s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:17 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 is being set with open permissions: ugo+rw Nov 05 12:06:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:17 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 Nov 05 12:06:17 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:18 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107" returned: 0 in 0.417s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:18 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.info Nov 05 12:06:18 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:18 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.info" returned: 0 in 0.330s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:18 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.info is being set with open permissions: ugo+rw Nov 05 12:06:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:18 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.info Nov 05 12:06:18 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:19 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.info" returned: 0 in 0.645s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-cc0708be-a061-4ce6-ba49-df3b1e865320 tempest-VolumesDeleteCascade-617797462 None] Create snapshot completed successfully Nov 05 12:06:20 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Flow 'volume_create_manager' (16feb409-ddc0-4e51-8620-ef13c5d5f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a83f9a0-4ff9-47d3-8f8c-a54764829812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a83f9a0-4ff9-47d3-8f8c-a54764829812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1642629409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482360da-d2fd-4732-b3bb-4d4b534e8045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac9fcf8316c4ba5b8e419117fabfee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6b8a492-7569-43f3-ba39-c221c70e0107,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:21Z,use_quota=True,user_id='a5ca9458a7544dfea9ea75002bb2e3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7928cc68-1c36-4cde-9f43-2131770dd4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7928cc68-1c36-4cde-9f43-2131770dd4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14646e82-f608-464c-8305-1d1f9a0a9471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14646e82-f608-464c-8305-1d1f9a0a9471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '482360da-d2fd-4732-b3bb-4d4b534e8045', 'volume_name': 'volume-482360da-d2fd-4732-b3bb-4d4b534e8045', 'volume_size': 1, 'snapshot_id': 'a6b8a492-7569-43f3-ba39-c221c70e0107'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f583ae7a-6259-4be4-827a-4e670b1a9af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f583ae7a-6259-4be4-827a-4e670b1a9af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9d05bb-ddaf-463d-bae3-5625e84ca8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Volume 482360da-d2fd-4732-b3bb-4d4b534e8045: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-482360da-d2fd-4732-b3bb-4d4b534e8045', 'volume_size': 1, 'snapshot_id': 'a6b8a492-7569-43f3-ba39-c221c70e0107'} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-a6b8a492-7569-43f3-ba39-c221c70e0107-482360da-d2fd-4732-b3bb-4d4b534e8045" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-a6b8a492-7569-43f3-ba39-c221c70e0107-482360da-d2fd-4732-b3bb-4d4b534e8045" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Creating volume 482360da-d2fd-4732-b3bb-4d4b534e8045 from snapshot a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-482360da-d2fd-4732-b3bb-4d4b534e8045" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-482360da-d2fd-4732-b3bb-4d4b534e8045" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] snapshot: a6b8a492-7569-43f3-ba39-c221c70e0107, volume: 482360da-d2fd-4732-b3bb-4d4b534e8045, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00c910-109c-4fd9-a818-b415e15b81bf]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:21 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 Nov 05 12:06:21 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:21 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107" returned: 0 in 0.453s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82bc3190-f5b4-44ef-8114-b0464a08a450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[01637050-2b89-4dae-8af4-c201601b9921]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:21 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 Nov 05 12:06:21 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:22 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450" returned: 0 in 0.500s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:06:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:06:22 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:06:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:22 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 Nov 05 12:06:22 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=42,cinder:INSERT=16,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=44,cinder:INSERT=14,cinder:UPDATE=52,cinder:DELETE=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:06:31 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045" returned: 0 in 9.187s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450, size 1024.00 MB, duration 9.19 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:06:31 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Converted 1024.00 MB image at 111.45 MB/s Nov 05 12:06:31 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 is being set with open permissions: ugo+rw Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:31 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 Nov 05 12:06:31 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:31 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045" returned: 0 in 0.328s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-482360da-d2fd-4732-b3bb-4d4b534e8045" released by "_copy_volume_from_snapshot" :: held 10.612s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-a6b8a492-7569-43f3-ba39-c221c70e0107-482360da-d2fd-4732-b3bb-4d4b534e8045" released by "_create_volume_from_snapshot" :: held 10.751s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.774s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9d05bb-ddaf-463d-bae3-5625e84ca8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482360da-d2fd-4732-b3bb-4d4b534e8045', 'volume_size': 1, 'snapshot_id': 'a6b8a492-7569-43f3-ba39-c221c70e0107'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521c07a0-17dc-46e2-a63c-98c7a5af55cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Volume volume-482360da-d2fd-4732-b3bb-4d4b534e8045 (482360da-d2fd-4732-b3bb-4d4b534e8045): created successfully Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521c07a0-17dc-46e2-a63c-98c7a5af55cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Flow 'volume_create_manager' (16feb409-ddc0-4e51-8620-ef13c5d5f505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0bdebad9-3aa4-413e-922d-390635f08288 tempest-VolumesDeleteCascade-617797462 None] Created volume successfully. Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-82bc3190-f5b4-44ef-8114-b0464a08a450-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-82bc3190-f5b4-44ef-8114-b0464a08a450-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Performing cascade delete. {{(pid=86942) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-a6b8a492-7569-43f3-ba39-c221c70e0107-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-a6b8a492-7569-43f3-ba39-c221c70e0107-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-82bc3190-f5b4-44ef-8114-b0464a08a450" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-82bc3190-f5b4-44ef-8114-b0464a08a450" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-a6b8a492-7569-43f3-ba39-c221c70e0107" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-a6b8a492-7569-43f3-ba39-c221c70e0107" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Deleting offline snapshot a6b8a492-7569-43f3-ba39-c221c70e0107 of volume 82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] snapshot_file for this snap is: volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f474463c-bf7e-4f88-9930-0f22bfb8f123]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:06:32 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 Nov 05 12:06:32 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Flow 'volume_create_manager' (16fce16d-c2e0-4b20-8856-f77c064c5b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebf5a0d-b65c-4628-b132-269370aa0a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebf5a0d-b65c-4628-b132-269370aa0a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1957335629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d191a6e1-62c1-4192-a9de-c6eef4a16f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607611d1906f4cf7a878353e7811dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:33Z,use_quota=True,user_id='f51ba5ab57f9486db3584a9b5c44f092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc1dcb9-fac3-46a8-bb50-a3f8ab180945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc1dcb9-fac3-46a8-bb50-a3f8ab180945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1832793c-7a0a-4bb8-bc82-082247e06c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1832793c-7a0a-4bb8-bc82-082247e06c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd191a6e1-62c1-4192-a9de-c6eef4a16f5e', 'volume_name': 'volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e5bd74-6d79-4a6b-ba71-efa6c0c54de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e5bd74-6d79-4a6b-ba71-efa6c0c54de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b810570-e029-4d69-a3e5-aa71f8a7139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Volume d191a6e1-62c1-4192-a9de-c6eef4a16f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e', 'volume_size': 1} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1957335629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d191a6e1-62c1-4192-a9de-c6eef4a16f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607611d1906f4cf7a878353e7811dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:33Z,use_quota=True,user_id='f51ba5ab57f9486db3584a9b5c44f092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Creating volume d191a6e1-62c1-4192-a9de-c6eef4a16f5e {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:06:33 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:33 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e 1073741824 Nov 05 12:06:33 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:33 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107" returned: 0 in 0.660s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82bc3190-f5b4-44ef-8114-b0464a08a450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de67047-bf03-4a5c-8fd3-35ff22ec6be8]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:33 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 Nov 05 12:06:33 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:33 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e 1073741824" returned: 0 in 0.791s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:34 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e Nov 05 12:06:34 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:34 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e" returned: 0 in 0.416s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b810570-e029-4d69-a3e5-aa71f8a7139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4927aa-0674-48f3-8e75-7b1a6700fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:34 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Volume volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e (d191a6e1-62c1-4192-a9de-c6eef4a16f5e): created successfully Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4927aa-0674-48f3-8e75-7b1a6700fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Flow 'volume_create_manager' (16fce16d-c2e0-4b20-8856-f77c064c5b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-81797cef-11d0-4b83-9d41-ce01c8754ce9 tempest-AttachVolumeTestJSON-1534323722 None] Created volume successfully. Nov 05 12:06:34 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450" returned: 0 in 0.971s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:34 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 Nov 05 12:06:34 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:35 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107" returned: 0 in 0.513s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:35 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107 Nov 05 12:06:35 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:35 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450.a6b8a492-7569-43f3-ba39-c221c70e0107" returned: 0 in 0.385s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-a6b8a492-7569-43f3-ba39-c221c70e0107" released by "_delete_snapshot" :: held 2.719s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-82bc3190-f5b4-44ef-8114-b0464a08a450" released by "delete_snapshot" :: held 2.762s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Created reservations ['f0f4522c-43fb-4bd6-85fc-9ef3aeec0753', '2bb24fa9-4b0a-44a4-9614-69e4926d1baf', 'b9690d6d-f6dc-4dc7-9e11-b9e488dc25bb', 'ca46fa3e-b49e-4b87-b95b-392e4d58485e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:35 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Delete snapshot completed successfully. Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-a6b8a492-7569-43f3-ba39-c221c70e0107-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Snapshots deleted, issuing volume delete {{(pid=86942) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-82bc3190-f5b4-44ef-8114-b0464a08a450" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-82bc3190-f5b4-44ef-8114-b0464a08a450" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc66674f-d709-48d8-b9f3-24db98261bd7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:35 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 Nov 05 12:06:35 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:36 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450" returned: 0 in 0.568s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:36 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450 Nov 05 12:06:36 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:36 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-82bc3190-f5b4-44ef-8114-b0464a08a450" returned: 0 in 0.486s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-82bc3190-f5b4-44ef-8114-b0464a08a450" released by "delete_volume" :: held 1.165s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:36 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Created reservations ['8c85b6d1-1585-4224-875e-64bbaef75962', '09e8adbb-3996-4fb5-8395-4e5f39c150d5', 'e49b6255-e4eb-441e-a029-ec3bdeaa790d', '626b0fb9-974b-4088-91f8-0632e86c038d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-0cb35963-9445-49a3-80fc-a2f43bc6b710 req-06cbb878-261b-4584-bc18-e5be9bfba977 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-0cb35963-9445-49a3-80fc-a2f43bc6b710 req-06cbb878-261b-4584-bc18-e5be9bfba977 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-0cb35963-9445-49a3-80fc-a2f43bc6b710 req-06cbb878-261b-4584-bc18-e5be9bfba977 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-0cb35963-9445-49a3-80fc-a2f43bc6b710 req-06cbb878-261b-4584-bc18-e5be9bfba977 tempest-AttachVolumeTestJSON-1534323722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9693d0f8-755b-47eb-8e4f-139452ac724e', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:06:37 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:06:37 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-0cb35963-9445-49a3-80fc-a2f43bc6b710 req-06cbb878-261b-4584-bc18-e5be9bfba977 tempest-AttachVolumeTestJSON-1534323722 None] attachment_update completed successfully. Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-482360da-d2fd-4732-b3bb-4d4b534e8045-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-482360da-d2fd-4732-b3bb-4d4b534e8045-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "cinder-quobyte-482360da-d2fd-4732-b3bb-4d4b534e8045" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-482360da-d2fd-4732-b3bb-4d4b534e8045" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9548fdde-7d24-451c-8576-591025be9af5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:37 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.542s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:06:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Deleted volume successfully. Nov 05 12:06:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4c05c33f-a4d7-4e22-8a08-3c225effc07c tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-82bc3190-f5b4-44ef-8114-b0464a08a450-delete_volume" released by "delete_volume" :: held 5.201s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:37 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 Nov 05 12:06:37 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:38 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045" returned: 0 in 0.661s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:38 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045 Nov 05 12:06:38 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:38 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-482360da-d2fd-4732-b3bb-4d4b534e8045" returned: 0 in 0.471s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-quobyte-482360da-d2fd-4732-b3bb-4d4b534e8045" released by "delete_volume" :: held 1.228s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Created reservations ['7ca77b7e-c24f-4ce6-98f1-4d3b83089d70', 'a17ce845-1fb6-4e77-ba1a-4adb9ea22cc6', '97ee1514-6101-42b9-a157-d3d4520dea2b', '21c51f98-b7d6-4d27-95f5-1eecbd8766b6'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:38 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:06:38 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:39 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:39 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:06:39 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Deleted volume successfully. Nov 05 12:06:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-45e1a015-8517-46e3-a485-63df57b427f7 tempest-VolumesDeleteCascade-617797462 None] Lock "cinder-482360da-d2fd-4732-b3bb-4d4b534e8045-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Flow 'volume_create_manager' (269ecff5-794c-4008-a317-7a777592b1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e62cfb5-5148-4920-9835-5440a015712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e62cfb5-5148-4920-9835-5440a015712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-977884482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85979d0a-1aff-4e68-a53d-37fbebda0a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607611d1906f4cf7a878353e7811dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:40Z,use_quota=True,user_id='f51ba5ab57f9486db3584a9b5c44f092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac4600b-4c8b-4b08-9bc5-685325b75ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac4600b-4c8b-4b08-9bc5-685325b75ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943156b5-dcd7-435e-8f4c-135d6dbe4ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943156b5-dcd7-435e-8f4c-135d6dbe4ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85979d0a-1aff-4e68-a53d-37fbebda0a15', 'volume_name': 'volume-85979d0a-1aff-4e68-a53d-37fbebda0a15', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285636c9-057f-4fd5-94d5-d3f6c879ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285636c9-057f-4fd5-94d5-d3f6c879ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68784890-5180-4039-95b7-1c9bde084af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:40 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Volume 85979d0a-1aff-4e68-a53d-37fbebda0a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85979d0a-1aff-4e68-a53d-37fbebda0a15', 'volume_size': 1} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-977884482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85979d0a-1aff-4e68-a53d-37fbebda0a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607611d1906f4cf7a878353e7811dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:40Z,use_quota=True,user_id='f51ba5ab57f9486db3584a9b5c44f092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Creating volume 85979d0a-1aff-4e68-a53d-37fbebda0a15 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:06:40 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:06:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:40 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 1073741824 Nov 05 12:06:40 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:41 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 1073741824" returned: 0 in 0.778s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:41 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 Nov 05 12:06:41 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:41 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15" returned: 0 in 0.295s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68784890-5180-4039-95b7-1c9bde084af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85979d0a-1aff-4e68-a53d-37fbebda0a15', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934b20e5-1697-44f8-a805-c2fd6c4cb59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Volume volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 (85979d0a-1aff-4e68-a53d-37fbebda0a15): created successfully Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934b20e5-1697-44f8-a805-c2fd6c4cb59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Flow 'volume_create_manager' (269ecff5-794c-4008-a317-7a777592b1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-28513a8d-704c-4646-aa44-feab09f9a802 tempest-AttachVolumeTestJSON-1534323722 None] Created volume successfully. Nov 05 12:06:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-89c4404d-bc80-4e2f-a98e-9e8ab318fb10 req-6c854b4c-0863-4049-9bbe-7bbda83033e7 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-89c4404d-bc80-4e2f-a98e-9e8ab318fb10 req-6c854b4c-0863-4049-9bbe-7bbda83033e7 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-89c4404d-bc80-4e2f-a98e-9e8ab318fb10 req-6c854b4c-0863-4049-9bbe-7bbda83033e7 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-89c4404d-bc80-4e2f-a98e-9e8ab318fb10 req-6c854b4c-0863-4049-9bbe-7bbda83033e7 tempest-AttachVolumeTestJSON-1534323722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-85979d0a-1aff-4e68-a53d-37fbebda0a15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0255cd3-67cd-42c4-a94d-9ac926233242', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:06:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-89c4404d-bc80-4e2f-a98e-9e8ab318fb10 req-6c854b4c-0863-4049-9bbe-7bbda83033e7 tempest-AttachVolumeTestJSON-1534323722 None] attachment_update completed successfully. Nov 05 12:06:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-54a4c1ef-b54e-4d30-a7b4-4613e1627f5c req-0b3a37ec-dcb3-4e2d-aaac-2479bb9f4913 tempest-AttachVolumeTestJSON-1534323722 None] Terminate volume connection completed successfully. Nov 05 12:06:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-54a4c1ef-b54e-4d30-a7b4-4613e1627f5c req-0b3a37ec-dcb3-4e2d-aaac-2479bb9f4913 tempest-AttachVolumeTestJSON-1534323722 None] Deleting attachment 9693d0f8-755b-47eb-8e4f-139452ac724e. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:06:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-836f3c5a-a499-4179-bd42-484ac8859454 req-d7c492e5-7130-4dd0-9ec5-ffec88fd0294 tempest-AttachVolumeTestJSON-1534323722 None] Terminate volume connection completed successfully. Nov 05 12:06:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-836f3c5a-a499-4179-bd42-484ac8859454 req-d7c492e5-7130-4dd0-9ec5-ffec88fd0294 tempest-AttachVolumeTestJSON-1534323722 None] Deleting attachment f0255cd3-67cd-42c4-a94d-9ac926233242. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Flow 'volume_create_manager' (5dc43817-99a6-47fc-a103-10c97479d4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d29a869-cc85-4666-931f-b352e0b12b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d29a869-cc85-4666-931f-b352e0b12b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1197456233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c59fead-07b7-4d78-9bfc-c964b995a0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d9d9870eaa4295a4d3547cee95ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:50Z,use_quota=True,user_id='24ce522186184015ba94f8bec6ee6b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de911a8-c9d0-401f-b81c-52ddbbd7893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de911a8-c9d0-401f-b81c-52ddbbd7893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60cac66-51af-4483-ae07-fb7721b89d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60cac66-51af-4483-ae07-fb7721b89d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c59fead-07b7-4d78-9bfc-c964b995a0f4', 'volume_name': 'volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a9e43c-8c31-4259-8754-11f660f17c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a9e43c-8c31-4259-8754-11f660f17c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99fb8c7-18e6-422e-85b0-97b8a0dcc493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:50 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Volume 9c59fead-07b7-4d78-9bfc-c964b995a0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4', 'volume_size': 1} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1197456233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c59fead-07b7-4d78-9bfc-c964b995a0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d9d9870eaa4295a4d3547cee95ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:50Z,use_quota=True,user_id='24ce522186184015ba94f8bec6ee6b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Creating volume 9c59fead-07b7-4d78-9bfc-c964b995a0f4 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:06:50 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:06:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:50 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 1073741824 Nov 05 12:06:50 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:51 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 1073741824" returned: 0 in 0.834s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:51 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 Nov 05 12:06:51 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:51 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4" returned: 0 in 0.334s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99fb8c7-18e6-422e-85b0-97b8a0dcc493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6641a3-ec83-49c7-98ae-a5b40f71e372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Volume volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 (9c59fead-07b7-4d78-9bfc-c964b995a0f4): created successfully Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6641a3-ec83-49c7-98ae-a5b40f71e372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Flow 'volume_create_manager' (5dc43817-99a6-47fc-a103-10c97479d4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d50318b4-d213-42f6-8a21-a9838a9c55eb tempest-TestImageHashVerification-1738949398 None] Created volume successfully. Nov 05 12:06:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:06:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:06:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:06:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:06:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:52 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:06:52 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:53 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.541s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:06:53 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:06:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:06:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:06:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:06:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5c841-f4a1-44fb-af9f-d737496fa32a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:54 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 Nov 05 12:06:54 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:54 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4" returned: 0 in 0.652s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfcb45d-634c-4ee1-a3fa-d4ea7942e9cb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:54 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 Nov 05 12:06:54 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:55 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4" returned: 0 in 0.676s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 /opt/stack/data/cinder/conversion/9c59fead-07b7-4d78-9bfc-c964b995a0f4.temp_image.e5bd018c-e586-4c47-8657-6eee38973103m8_pcpev.img {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:55 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 /opt/stack/data/cinder/conversion/9c59fead-07b7-4d78-9bfc-c964b995a0f4.temp_image.e5bd018c-e586-4c47-8657-6eee38973103m8_pcpev.img Nov 05 12:06:55 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Flow 'volume_create_manager' (39deab3c-ba75-44a9-9fd5-488400aba564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5027426-a7f8-4bcb-bed7-0939a1f025ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5027426-a7f8-4bcb-bed7-0939a1f025ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2080099346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58244ec3-4586-4129-b048-7b99ed7d5687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffe33aef6734bf386d0cdda272f783b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:56Z,use_quota=True,user_id='f45474df5e5e4cd18cfc42d08d714cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a409791b-c6b7-4a12-919e-23bca105505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a409791b-c6b7-4a12-919e-23bca105505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbcbff4-5bbf-4646-af37-a237d396768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbcbff4-5bbf-4646-af37-a237d396768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58244ec3-4586-4129-b048-7b99ed7d5687', 'volume_name': 'volume-58244ec3-4586-4129-b048-7b99ed7d5687', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5d16d2-efab-4704-a6a4-378ef7e7ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5d16d2-efab-4704-a6a4-378ef7e7ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9d0b3a-b9df-4db8-bf59-1c006b0c314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:06:55 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Volume 58244ec3-4586-4129-b048-7b99ed7d5687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58244ec3-4586-4129-b048-7b99ed7d5687', 'volume_size': 1} Nov 05 12:06:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:06:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "cinder-85979d0a-1aff-4e68-a53d-37fbebda0a15-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-85979d0a-1aff-4e68-a53d-37fbebda0a15-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "cinder-quobyte-85979d0a-1aff-4e68-a53d-37fbebda0a15" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:06:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-quobyte-85979d0a-1aff-4e68-a53d-37fbebda0a15" acquired by "delete_volume" :: waited 0.049s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:06:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2877a-e6a6-4d0e-9e7e-3012209a499f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:06:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:06:59 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 Nov 05 12:06:59 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:00 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15" returned: 0 in 0.929s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:00 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15 Nov 05 12:07:00 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:00 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-85979d0a-1aff-4e68-a53d-37fbebda0a15" returned: 0 in 0.466s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-quobyte-85979d0a-1aff-4e68-a53d-37fbebda0a15" released by "delete_volume" :: held 1.516s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:00 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Created reservations ['2f41f8a7-061e-4f06-98c4-cd78ab70c3cb', '405e0b3c-2e9c-4baf-aa02-12083f0c7a60', '71158180-e74e-49ac-8ae2-b36d05c0209e', 'bb3fa3b7-2f94-452b-a44f-513f0918e60c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:01 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:01 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "cinder-d191a6e1-62c1-4192-a9de-c6eef4a16f5e-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-d191a6e1-62c1-4192-a9de-c6eef4a16f5e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "cinder-quobyte-d191a6e1-62c1-4192-a9de-c6eef4a16f5e" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-quobyte-d191a6e1-62c1-4192-a9de-c6eef4a16f5e" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:01 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.756s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:01 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Deleted volume successfully. Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd24e1-881f-4af0-9bd2-e4c4c41da0e8]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5f08193a-b052-4ba6-961c-d78218d80dab tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-85979d0a-1aff-4e68-a53d-37fbebda0a15-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:02 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e Nov 05 12:07:02 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:02 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e" returned: 0 in 1.048s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:02 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e Nov 05 12:07:02 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:03 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d191a6e1-62c1-4192-a9de-c6eef4a16f5e" returned: 0 in 0.700s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-quobyte-d191a6e1-62c1-4192-a9de-c6eef4a16f5e" released by "delete_volume" :: held 1.941s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:03 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Created reservations ['5d7b3bce-5ade-4e03-b465-f7bfd5ebedb7', '3a58344d-7e07-410e-83da-b89e4ad6f2f0', '7649eb2d-fc0f-4e7e-a9be-45ac11b19273', 'ece539d1-7931-45d9-927d-25ac71202b01'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:04 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:04 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Flow 'volume_create_manager' (ad8d4a71-39eb-4171-99e7-7404be98841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e2d9d2-8add-49ab-bb50-e43dc9de9c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "cinder-d9722c0a-a4bc-474f-896b-5450cb84075b-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e2d9d2-8add-49ab-bb50-e43dc9de9c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2098719241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e5516d-ec2d-4052-8b88-fc746c8b6396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ccc2f26e6d434b84236a57d8646df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:04Z,use_quota=True,user_id='2a5f5870723040c784fabb3fca79c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(194af370-6e1b-482c-aa38-e53ec44a1034),volume_type_id=194af370-6e1b-482c-aa38-e53ec44a1034)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab8f32-2da4-4789-92be-4545b201a168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab8f32-2da4-4789-92be-4545b201a168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045b6399-3636-4b8a-8ca9-d88bbcdd8926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045b6399-3636-4b8a-8ca9-d88bbcdd8926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e5516d-ec2d-4052-8b88-fc746c8b6396', 'volume_name': 'volume-01e5516d-ec2d-4052-8b88-fc746c8b6396', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956ac6e5-a44f-4f23-897c-4b750a792672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956ac6e5-a44f-4f23-897c-4b750a792672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66066d2e-aff4-486f-be0f-8c45c133ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:04 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume 01e5516d-ec2d-4052-8b88-fc746c8b6396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e5516d-ec2d-4052-8b88-fc746c8b6396', 'volume_size': 1} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-d9722c0a-a4bc-474f-896b-5450cb84075b-delete_volume" acquired by "delete_volume" :: waited 0.213s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:04 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.869s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:04 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "cinder-quobyte-d9722c0a-a4bc-474f-896b-5450cb84075b" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Deleted volume successfully. Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-quobyte-d9722c0a-a4bc-474f-896b-5450cb84075b" acquired by "delete_volume" :: waited 0.048s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9751747f-3899-41e2-875b-e6c9ead68940 tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-d191a6e1-62c1-4192-a9de-c6eef4a16f5e-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd815992-b55b-4ffd-b3fe-f81c541a9247]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:05 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 /opt/stack/data/cinder/conversion/9c59fead-07b7-4d78-9bfc-c964b995a0f4.temp_image.e5bd018c-e586-4c47-8657-6eee38973103m8_pcpev.img" returned: 0 in 9.818s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c0d76-2d38-4b78-b409-84cd2c4032dd]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:05 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b Nov 05 12:07:05 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:05 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 Nov 05 12:07:05 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Flow 'volume_create_manager' (9f901b6e-2bab-4ed6-89e7-ca7e7849ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41edc97e-8965-45c2-ac81-4c8e42ed3c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41edc97e-8965-45c2-ac81-4c8e42ed3c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1574492320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5584c7-5baa-4e0e-aba7-c9605d6e915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ccc2f26e6d434b84236a57d8646df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:05Z,use_quota=True,user_id='2a5f5870723040c784fabb3fca79c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4b0991e-d6fb-4db3-aaa4-de5997d5c1e4),volume_type_id=e4b0991e-d6fb-4db3-aaa4-de5997d5c1e4)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcf5e7a-034f-446e-bdb8-ac14a821b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcf5e7a-034f-446e-bdb8-ac14a821b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f3c5dc-0df2-4142-ac60-338ed648f760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f3c5dc-0df2-4142-ac60-338ed648f760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5584c7-5baa-4e0e-aba7-c9605d6e915c', 'volume_name': 'volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393f1f8a-0685-4bd8-81aa-d394a15651f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393f1f8a-0685-4bd8-81aa-d394a15651f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12345a3-895c-46af-b0f6-1ca92ea8478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume 8c5584c7-5baa-4e0e-aba7-c9605d6e915c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c', 'volume_size': 1} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:05 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b" returned: 0 in 0.553s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:05 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b Nov 05 12:07:05 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:05 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4" returned: 0 in 0.723s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4, size 1024.00 MB, duration 9.82 sec, destination /opt/stack/data/cinder/conversion/9c59fead-07b7-4d78-9bfc-c964b995a0f4.temp_image.e5bd018c-e586-4c47-8657-6eee38973103m8_pcpev.img {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:07:05 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Converted 1024.00 MB image at 104.28 MB/s Nov 05 12:07:05 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] e5bd018c-e586-4c47-8657-6eee38973103 was raw, no need to convert to raw {{(pid=86942) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 12:07:06 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d9722c0a-a4bc-474f-896b-5450cb84075b" returned: 0 in 0.351s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-quobyte-d9722c0a-a4bc-474f-896b-5450cb84075b" released by "delete_volume" :: held 1.034s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Created reservations ['09eb7e58-4225-4c86-a087-24710311b332', '6a137e1e-4570-4ff5-9b09-6a79990818e9', 'e612e92a-4ee4-4849-a63d-d60c044f3509', 'f99eb008-f9e4-4d16-ae6b-88f46335da72'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:06 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:06 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Flow 'volume_create_manager' (47d40ae1-e0fd-47e1-a687-641540389c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9d213e-a535-4ecc-aede-6b14c7a62f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9d213e-a535-4ecc-aede-6b14c7a62f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2101980694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84ef485-f9ef-4c1b-af3f-d055e3920964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ccc2f26e6d434b84236a57d8646df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:06Z,use_quota=True,user_id='2a5f5870723040c784fabb3fca79c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6262692-e331-4290-bfda-8caaf48d80ca),volume_type_id=b6262692-e331-4290-bfda-8caaf48d80ca)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1631db0-a212-4c96-b122-3324bc8c7139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1631db0-a212-4c96-b122-3324bc8c7139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9431a7b-dfc3-4807-a3ac-7415028f9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:07:06 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.303s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Deleted volume successfully. Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a7966db6-cc0d-49d1-90cf-3bf8db61049e tempest-AttachVolumeTestJSON-1534323722 None] Lock "cinder-d9722c0a-a4bc-474f-896b-5450cb84075b-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9431a7b-dfc3-4807-a3ac-7415028f9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd84ef485-f9ef-4c1b-af3f-d055e3920964', 'volume_name': 'volume-d84ef485-f9ef-4c1b-af3f-d055e3920964', 'volume_size': 1, 'image_id': 'a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1655249602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59ccc2f26e6d434b84236a57d8646df5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'created_at': datetime.datetime(2026, 11, 5, 11, 6, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 7, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff/file', 'properties': {}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662e9432-d20b-4609-8b10-601a75fe0577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662e9432-d20b-4609-8b10-601a75fe0577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cdc560-9d11-48ef-b963-dfd07ab7a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:06 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume d84ef485-f9ef-4c1b-af3f-d055e3920964: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d84ef485-f9ef-4c1b-af3f-d055e3920964', 'volume_size': 1, 'image_id': 'a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1655249602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59ccc2f26e6d434b84236a57d8646df5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'created_at': datetime.datetime(2026, 11, 5, 11, 6, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 7, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff/file', 'properties': {}}, 'image_service': } Nov 05 12:07:06 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Trying to clone d84ef485-f9ef-4c1b-af3f-d055e3920964 from image a0cd6996-f4f8-4448-9bf2-5827cb3e60ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:07:11 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD, size 20.69 MB, duration 4.27 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:07:11 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Image download 20.69 MB at 4.84 MB/s Nov 05 12:07:11 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bce4cd-ac8b-49a8-ba78-6735cc633383]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:11 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD Nov 05 12:07:11 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:11 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:11 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Temporary image a0cd6996-f4f8-4448-9bf2-5827cb3e60ff is fetched for user 2a5f5870723040c784fabb3fca79c812. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:07:11 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1506b310-610c-4f8b-b227-56096af2a22f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:11 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD Nov 05 12:07:11 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:12 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Flow 'volume_create_manager' (cfe2da2f-2670-4b51-bc2b-f537c4570931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89bc947-c9f6-44dc-a214-8973fa103d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89bc947-c9f6-44dc-a214-8973fa103d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1552212124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db226927-4805-4050-843d-f947793c4a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f943ec539648368eede4d2b6a7c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:17Z,use_quota=True,user_id='2a79c200ee1e4e8b8a1790867916ec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1819087c-fdda-4d29-941a-074f5ec952aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1819087c-fdda-4d29-941a-074f5ec952aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccea93ce-4ab3-4c11-a792-e3eda7e801bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccea93ce-4ab3-4c11-a792-e3eda7e801bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db226927-4805-4050-843d-f947793c4a19', 'volume_name': 'volume-db226927-4805-4050-843d-f947793c4a19', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13791cb-0c56-447c-907d-39e4caba12dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13791cb-0c56-447c-907d-39e4caba12dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfc533d-d9f1-4563-bf38-6d35483d348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:16 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Volume db226927-4805-4050-843d-f947793c4a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db226927-4805-4050-843d-f947793c4a19', 'volume_size': 1} Nov 05 12:07:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:26 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=67,cinder:UPDATE=56,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:07:26 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=54,cinder:UPDATE=69,cinder:DELETE=6,cinder:INSERT=13 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.637s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Uploaded volume to glance image-id: e5bd018c-e586-4c47-8657-6eee38973103. {{(pid=86942) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.703s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2080099346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58244ec3-4586-4129-b048-7b99ed7d5687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffe33aef6734bf386d0cdda272f783b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:56Z,use_quota=True,user_id='f45474df5e5e4cd18cfc42d08d714cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Creating volume 58244ec3-4586-4129-b048-7b99ed7d5687 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:27 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:27 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 1073741824 Nov 05 12:07:27 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-10b14884-6ac1-49ac-9b41-944251eb30a1 tempest-TestImageHashVerification-1738949398 None] Copy volume to image completed successfully. Nov 05 12:07:28 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 1073741824" returned: 0 in 0.507s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:28 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 Nov 05 12:07:28 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:28 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687" returned: 0 in 0.273s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.607s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2098719241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e5516d-ec2d-4052-8b88-fc746c8b6396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ccc2f26e6d434b84236a57d8646df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:04Z,use_quota=True,user_id='2a5f5870723040c784fabb3fca79c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(194af370-6e1b-482c-aa38-e53ec44a1034),volume_type_id=194af370-6e1b-482c-aa38-e53ec44a1034)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Creating volume 01e5516d-ec2d-4052-8b88-fc746c8b6396 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:28 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Acquiring lock "cinder-9c59fead-07b7-4d78-9bfc-c964b995a0f4-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:28 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 1073741824 Nov 05 12:07:28 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9d0b3a-b9df-4db8-bf59-1c006b0c314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58244ec3-4586-4129-b048-7b99ed7d5687', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91619e61-249d-46f4-aa24-8c598d2359a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Lock "cinder-9c59fead-07b7-4d78-9bfc-c964b995a0f4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:28 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Volume volume-58244ec3-4586-4129-b048-7b99ed7d5687 (58244ec3-4586-4129-b048-7b99ed7d5687): created successfully Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91619e61-249d-46f4-aa24-8c598d2359a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Flow 'volume_create_manager' (39deab3c-ba75-44a9-9fd5-488400aba564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:28 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2a400345-925b-4f06-a2aa-0b8493165c1a tempest-VolumesTransfersTest-1694831252 None] Created volume successfully. Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Acquiring lock "cinder-quobyte-9c59fead-07b7-4d78-9bfc-c964b995a0f4" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Lock "cinder-quobyte-9c59fead-07b7-4d78-9bfc-c964b995a0f4" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a35faa-ba5b-4c5e-a985-5b6a4a13a48e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:28 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 Nov 05 12:07:28 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:29 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 1073741824" returned: 0 in 0.607s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:29 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4" returned: 0 in 0.460s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:29 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4 Nov 05 12:07:29 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:29 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 Nov 05 12:07:29 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:29 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9c59fead-07b7-4d78-9bfc-c964b995a0f4" returned: 0 in 0.332s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:29 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396" returned: 0 in 0.307s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Lock "cinder-quobyte-9c59fead-07b7-4d78-9bfc-c964b995a0f4" released by "delete_volume" :: held 0.840s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.903s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1574492320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5584c7-5baa-4e0e-aba7-c9605d6e915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ccc2f26e6d434b84236a57d8646df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:05Z,use_quota=True,user_id='2a5f5870723040c784fabb3fca79c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4b0991e-d6fb-4db3-aaa4-de5997d5c1e4),volume_type_id=e4b0991e-d6fb-4db3-aaa4-de5997d5c1e4)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Creating volume 8c5584c7-5baa-4e0e-aba7-c9605d6e915c {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:29 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:29 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c 1073741824 Nov 05 12:07:29 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66066d2e-aff4-486f-be0f-8c45c133ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e5516d-ec2d-4052-8b88-fc746c8b6396', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe072f7f-01a6-446d-b4fe-188887df2555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 (01e5516d-ec2d-4052-8b88-fc746c8b6396): created successfully Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe072f7f-01a6-446d-b4fe-188887df2555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Flow 'volume_create_manager' (ad8d4a71-39eb-4171-99e7-7404be98841e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5e5087ab-9629-4591-bdb0-34286aa7c5e8 tempest-TestInstancesWithCinderVolumes-1097274233 None] Created volume successfully. Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Created reservations ['a0353c8d-cf0b-4202-94e0-a9764dedf835', '51dde28f-6c29-4fb9-94c1-1e6d6ae60352', '1ecb7543-3fde-42fb-9e94-80ad20ef96bd', '71f62cde-0676-40ab-ae9d-c3778deb5de5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:29 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:29 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-424794b9-5d34-4603-bcfe-c51c12594616 tempest-VolumesTransfersTest-961249916 None] Transfer volume completed successfully. Nov 05 12:07:30 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:30 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c 1073741824" returned: 0 in 0.584s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Deleted volume successfully. Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e52d3a7c-ab11-433b-b897-1153c5933887 tempest-TestImageHashVerification-1738949398 None] Lock "cinder-9c59fead-07b7-4d78-9bfc-c964b995a0f4-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:30 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c Nov 05 12:07:30 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:30 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c" returned: 0 in 0.262s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.234s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2101980694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84ef485-f9ef-4c1b-af3f-d055e3920964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ccc2f26e6d434b84236a57d8646df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:06Z,use_quota=True,user_id='2a5f5870723040c784fabb3fca79c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6262692-e331-4290-bfda-8caaf48d80ca),volume_type_id=b6262692-e331-4290-bfda-8caaf48d80ca)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Creating volume d84ef485-f9ef-4c1b-af3f-d055e3920964 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:30 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12345a3-895c-46af-b0f6-1ca92ea8478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:30 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 1073741824 Nov 05 12:07:30 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f187b6e-cac7-4ebe-be89-0ad8e403040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c (8c5584c7-5baa-4e0e-aba7-c9605d6e915c): created successfully Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f187b6e-cac7-4ebe-be89-0ad8e403040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Flow 'volume_create_manager' (9f901b6e-2bab-4ed6-89e7-ca7e7849ef22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9f4db183-0520-49ac-9f81-d83608f476b7 tempest-TestInstancesWithCinderVolumes-1097274233 None] Created volume successfully. Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Acquiring lock "cinder-58244ec3-4586-4129-b048-7b99ed7d5687-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-58244ec3-4586-4129-b048-7b99ed7d5687-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Acquiring lock "cinder-quobyte-58244ec3-4586-4129-b048-7b99ed7d5687" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-quobyte-58244ec3-4586-4129-b048-7b99ed7d5687" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8568093-3704-4c48-9b34-e89b314af969]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:30 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 Nov 05 12:07:30 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:31 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 1073741824" returned: 0 in 0.605s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:31 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 Nov 05 12:07:31 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:31 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687" returned: 0 in 0.450s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:31 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687 Nov 05 12:07:31 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:31 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964" returned: 0 in 0.303s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.475s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1552212124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db226927-4805-4050-843d-f947793c4a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f943ec539648368eede4d2b6a7c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:17Z,use_quota=True,user_id='2a79c200ee1e4e8b8a1790867916ec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Creating volume db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:31 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:31 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 1073741824 Nov 05 12:07:31 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Attempting download of a0cd6996-f4f8-4448-9bf2-5827cb3e60ff ((None, [{'url': 'file:///opt/stack/data/glance/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'metadata': {}}])) to volume d84ef485-f9ef-4c1b-af3f-d055e3920964. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a7b266-eac4-418e-aa9c-a44424d45761]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff_mz8s0p94 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:31 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58244ec3-4586-4129-b048-7b99ed7d5687" returned: 0 in 0.305s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-quobyte-58244ec3-4586-4129-b048-7b99ed7d5687" released by "delete_volume" :: held 0.814s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Created reservations ['1a7f1098-0066-46bf-9cf5-e57af3641707', 'ed39294b-749f-491d-8030-12c0569dfb07', '01da1c02-43f3-4f50-a349-d51eb4924c8e', 'bf0ec711-0c48-47ee-b5ca-bca0e335ab3f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:31 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff_mz8s0p94 Nov 05 12:07:31 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:31 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:31 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:32 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff_mz8s0p94" returned: 0 in 0.512s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff_mz8s0p94 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:32 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 1073741824" returned: 0 in 0.666s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:32 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 Nov 05 12:07:32 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:32 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.403s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Deleted volume successfully. Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd152e0e-16a1-4fd8-adc8-0fc0efd666b2 tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-58244ec3-4586-4129-b048-7b99ed7d5687-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:32 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff_mz8s0p94 Nov 05 12:07:32 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:32 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19" returned: 0 in 0.438s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:32 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff_mz8s0p94" returned: 1 in 0.524s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff_mz8s0p94' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6ad74-5738-477d-a8c7-90afa378273e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfc533d-d9f1-4563-bf38-6d35483d348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db226927-4805-4050-843d-f947793c4a19', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6455b20b-996e-4fe8-a42a-24c1acb49248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:32 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Volume volume-db226927-4805-4050-843d-f947793c4a19 (db226927-4805-4050-843d-f947793c4a19): created successfully Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6455b20b-996e-4fe8-a42a-24c1acb49248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Flow 'volume_create_manager' (cfe2da2f-2670-4b51-bc2b-f537c4570931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-c5f05efe-97e7-4a6b-94f0-b37f7bee40a4 req-17e5cec4-e2c8-422d-8008-9b7df3fff8eb tempest-VolumesSnapshotsTestJSON-2099116642 None] Created volume successfully. Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:07:32 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD Nov 05 12:07:32 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Flow 'volume_create_manager' (b240be75-1cfc-4977-9aa5-6caae4ecfac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dedd0aa-219c-4a0f-b7f9-e41873742727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dedd0aa-219c-4a0f-b7f9-e41873742727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1316510671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a5e5b1-3078-42e6-a19c-59daccc02488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffe33aef6734bf386d0cdda272f783b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:33Z,use_quota=True,user_id='f45474df5e5e4cd18cfc42d08d714cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ad505-c960-409f-8df9-a32aaedb337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ad505-c960-409f-8df9-a32aaedb337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4640b1a4-65c6-4758-b014-504b1e90df44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4640b1a4-65c6-4758-b014-504b1e90df44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a5e5b1-3078-42e6-a19c-59daccc02488', 'volume_name': 'volume-d8a5e5b1-3078-42e6-a19c-59daccc02488', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02e9ef3-19f6-4708-87fa-9663f568afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02e9ef3-19f6-4708-87fa-9663f568afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4898b93-9d8a-42ae-819c-4839a8e451a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:32 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Volume d8a5e5b1-3078-42e6-a19c-59daccc02488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a5e5b1-3078-42e6-a19c-59daccc02488', 'volume_size': 1} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1316510671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a5e5b1-3078-42e6-a19c-59daccc02488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffe33aef6734bf386d0cdda272f783b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:33Z,use_quota=True,user_id='f45474df5e5e4cd18cfc42d08d714cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Creating volume d8a5e5b1-3078-42e6-a19c-59daccc02488 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:32 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:32 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 1073741824 Nov 05 12:07:32 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:32 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] a0cd6996-f4f8-4448-9bf2-5827cb3e60ff was qcow2, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:07:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:32 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 Nov 05 12:07:32 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:33 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 1073741824" returned: 0 in 0.481s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:33 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 Nov 05 12:07:33 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:33 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488" returned: 0 in 0.454s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4898b93-9d8a-42ae-819c-4839a8e451a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a5e5b1-3078-42e6-a19c-59daccc02488', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcb5206-2e07-42d5-99a2-9fc76e14f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Creating offline snapshot eb29afae-439f-415a-9795-21c83988431d of volume db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:07:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Volume volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 (d8a5e5b1-3078-42e6-a19c-59daccc02488): created successfully Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcb5206-2e07-42d5-99a2-9fc76e14f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Flow 'volume_create_manager' (b240be75-1cfc-4977-9aa5-6caae4ecfac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced138ac-d4ae-45e5-9571-27c1b14aa639]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2fe59a79-5e5f-4fe3-952d-cef541a6429b tempest-VolumesTransfersTest-1694831252 None] Created volume successfully. Nov 05 12:07:34 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 Nov 05 12:07:34 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:34 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19" returned: 0 in 0.509s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:34 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d 1G Nov 05 12:07:34 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:34 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d 1G" returned: 0 in 0.608s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db226927-4805-4050-843d-f947793c4a19 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:35 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db226927-4805-4050-843d-f947793c4a19 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d Nov 05 12:07:35 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Acquiring lock "cinder-d8a5e5b1-3078-42e6-a19c-59daccc02488-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-d8a5e5b1-3078-42e6-a19c-59daccc02488-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Acquiring lock "cinder-quobyte-d8a5e5b1-3078-42e6-a19c-59daccc02488" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-quobyte-d8a5e5b1-3078-42e6-a19c-59daccc02488" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:35 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db226927-4805-4050-843d-f947793c4a19 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d" returned: 0 in 0.440s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:35 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d is being set with open permissions: ugo+rw Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f8ddd6-809b-4fff-897a-5c92c4820742]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:35 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d Nov 05 12:07:35 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:35 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964" returned: 0 in 2.619s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a0cd6996-f4f8-4448-9bf2-5827cb3e60ff__0gqzy3sdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:07:35 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Converted 112.00 MB image at 42.74 MB/s Nov 05 12:07:35 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 Nov 05 12:07:35 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:35 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 1G Nov 05 12:07:35 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:35 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:35 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.info Nov 05 12:07:35 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:35 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488" returned: 0 in 0.414s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:35 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488 Nov 05 12:07:35 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:35 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 1G" returned: 0 in 0.364s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Downloaded image a0cd6996-f4f8-4448-9bf2-5827cb3e60ff ((None, [{'url': 'file:///opt/stack/data/glance/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'metadata': {}}])) to volume d84ef485-f9ef-4c1b-af3f-d055e3920964 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Temporary image a0cd6996-f4f8-4448-9bf2-5827cb3e60ff for user 2a5f5870723040c784fabb3fca79c812 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Marking volume d84ef485-f9ef-4c1b-af3f-d055e3920964 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Copying metadata from image a0cd6996-f4f8-4448-9bf2-5827cb3e60ff to d84ef485-f9ef-4c1b-af3f-d055e3920964. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:07:35 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Creating volume glance metadata for volume d84ef485-f9ef-4c1b-af3f-d055e3920964 backed by image a0cd6996-f4f8-4448-9bf2-5827cb3e60ff with: {'image_id': 'a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'image_name': 'tempest-scenario-img--1655249602', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cdc560-9d11-48ef-b963-dfd07ab7a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84ef485-f9ef-4c1b-af3f-d055e3920964', 'volume_size': 1, 'image_id': 'a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1655249602', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '59ccc2f26e6d434b84236a57d8646df5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a0cd6996-f4f8-4448-9bf2-5827cb3e60ff', 'created_at': datetime.datetime(2026, 11, 5, 11, 6, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 7, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0cd6996-f4f8-4448-9bf2-5827cb3e60ff/file', 'properties': {}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ef8ae4-c522-49b0-afef-1a7f1e194751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:36 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:36 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Volume volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 (d84ef485-f9ef-4c1b-af3f-d055e3920964): created successfully Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ef8ae4-c522-49b0-afef-1a7f1e194751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Flow 'volume_create_manager' (47d40ae1-e0fd-47e1-a687-641540389c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.info" returned: 0 in 0.344s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:36 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.info is being set with open permissions: ugo+rw Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7fbdad8c-7b16-4eb8-9eea-917b9eb1794c tempest-TestInstancesWithCinderVolumes-1097274233 None] Created volume successfully. Nov 05 12:07:36 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.info Nov 05 12:07:36 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:36 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d8a5e5b1-3078-42e6-a19c-59daccc02488" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-quobyte-d8a5e5b1-3078-42e6-a19c-59daccc02488" released by "delete_volume" :: held 0.814s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Created reservations ['fb9692a1-0b73-4bd8-9366-6f6848ce8424', '35f27c53-307c-4599-bbea-2e52303b9cbe', '551e839f-2a90-4243-823a-c3e733e139c5', '574d5076-ad74-466f-a916-c5db5c0f13ce'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:36 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:36 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:36 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.info" returned: 0 in 0.442s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-d152a357-b227-4ae2-977d-7c45f8fe63fd req-c9920b27-61e2-4b03-8aaf-830cde0173ac tempest-VolumesSnapshotsTestJSON-2099116642 None] Create snapshot completed successfully Nov 05 12:07:36 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.348s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Deleted volume successfully. Nov 05 12:07:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8d804db8-3a6b-481a-b0b2-a7eb73981acb tempest-VolumesTransfersTest-1021398213 None] Lock "cinder-d8a5e5b1-3078-42e6-a19c-59daccc02488-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "cinder-eb29afae-439f-415a-9795-21c83988431d-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-eb29afae-439f-415a-9795-21c83988431d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "cinder-quobyte-db226927-4805-4050-843d-f947793c4a19" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-quobyte-db226927-4805-4050-843d-f947793c4a19" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "cinder-quobyte-eb29afae-439f-415a-9795-21c83988431d" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-quobyte-eb29afae-439f-415a-9795-21c83988431d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Deleting offline snapshot eb29afae-439f-415a-9795-21c83988431d of volume db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] snapshot_file for this snap is: volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e6aedb-d996-4d06-966a-5cf23c5ba821]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:37 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d Nov 05 12:07:37 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:38 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d" returned: 0 in 0.483s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db226927-4805-4050-843d-f947793c4a19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:07:38 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb324b9e-5cf4-43c9-b704-14962d33b470]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:38 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 Nov 05 12:07:38 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:38 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19" returned: 0 in 0.652s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:38 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d Nov 05 12:07:38 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:39 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d" returned: 0 in 0.513s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:39 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d Nov 05 12:07:39 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:39 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19.eb29afae-439f-415a-9795-21c83988431d" returned: 0 in 0.342s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-quobyte-eb29afae-439f-415a-9795-21c83988431d" released by "_delete_snapshot" :: held 2.177s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-quobyte-db226927-4805-4050-843d-f947793c4a19" released by "delete_snapshot" :: held 2.222s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:39 devstack cinder-volume[86942]: DEBUG cinder.quota [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Created reservations ['ad7ac23c-2626-432b-9004-cb9dcaed736c', '1959d610-923a-4f00-93c0-2b54061befbd', '8705fe02-b5a9-4639-a46d-bf584d212681', '4230de81-7c40-42ce-901a-4e67392aa446'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:39 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Delete snapshot completed successfully. Nov 05 12:07:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-391c1034-c1bb-4cc9-b5b3-ffbf14bcd323 req-ea65322e-a5d0-420d-83b8-07dd81b9d74c tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-eb29afae-439f-415a-9795-21c83988431d-delete_snapshot" released by "delete_snapshot" :: held 2.501s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-daf4f178-e972-4843-97f4-715e7a1c545b req-12e26de4-b5a7-4fa0-b13a-1a18479b9145 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-daf4f178-e972-4843-97f4-715e7a1c545b req-12e26de4-b5a7-4fa0-b13a-1a18479b9145 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-daf4f178-e972-4843-97f4-715e7a1c545b req-12e26de4-b5a7-4fa0-b13a-1a18479b9145 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-daf4f178-e972-4843-97f4-715e7a1c545b req-12e26de4-b5a7-4fa0-b13a-1a18479b9145 tempest-TestInstancesWithCinderVolumes-1097274233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-d84ef485-f9ef-4c1b-af3f-d055e3920964', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a82fb523-6b24-4a66-a504-c3a6dc3e61a5', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:07:40 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-daf4f178-e972-4843-97f4-715e7a1c545b req-12e26de4-b5a7-4fa0-b13a-1a18479b9145 tempest-TestInstancesWithCinderVolumes-1097274233 None] attachment_update completed successfully. Nov 05 12:07:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "cinder-db226927-4805-4050-843d-f947793c4a19-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-db226927-4805-4050-843d-f947793c4a19-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "cinder-quobyte-db226927-4805-4050-843d-f947793c4a19" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-quobyte-db226927-4805-4050-843d-f947793c4a19" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc73a0e-13d2-4a10-bfec-01f1c41a053d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:41 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 Nov 05 12:07:41 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:41 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19" returned: 0 in 0.521s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:41 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19 Nov 05 12:07:41 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:42 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-db226927-4805-4050-843d-f947793c4a19" returned: 0 in 0.350s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-quobyte-db226927-4805-4050-843d-f947793c4a19" released by "delete_volume" :: held 0.975s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG cinder.quota [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Created reservations ['9b89c0a0-0850-420d-a3c5-98b66228aee6', '7a5ad339-b6ef-4c79-b62a-5ae2c75332b6', '08eed818-df0a-4194-a8a3-560d3db9fece', 'bb1dbb8b-617c-4135-8d8d-ec8b41e5bd77'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:42 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:42 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:42 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.304s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG cinder.manager [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Deleted volume successfully. Nov 05 12:07:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-d1a1bbca-0c6a-4f1e-9a9a-bac170288e65 req-2e1cdcb2-80c1-4f5f-b4b6-3e545933e8a4 tempest-VolumesSnapshotsTestJSON-2099116642 None] Lock "cinder-db226927-4805-4050-843d-f947793c4a19-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=58,cinder:SELECT=49,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:52 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:07:52 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:52 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=47,cinder:UPDATE=58,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:07:53 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.565s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:07:53 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:07:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:07:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Flow 'volume_create_manager' (d3a7aa46-ab51-45b2-8fbe-224835c88444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1c4e6c-d3b5-43d7-92ba-dbe23f9a96f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1c4e6c-d3b5-43d7-92ba-dbe23f9a96f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-387087521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bf820d-875c-4242-bf85-d8cb80e81319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021b55736a442e8ad617de8ef90605f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:54Z,use_quota=True,user_id='e7b802c06ea341908ed450b42538e866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09afcb83-430e-40d1-a205-25999bc53a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09afcb83-430e-40d1-a205-25999bc53a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe654760-977c-4492-9bb0-6d5c61c203ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe654760-977c-4492-9bb0-6d5c61c203ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58bf820d-875c-4242-bf85-d8cb80e81319', 'volume_name': 'volume-58bf820d-875c-4242-bf85-d8cb80e81319', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708afc58-f0d3-4d75-a65d-ea2e74a1dc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708afc58-f0d3-4d75-a65d-ea2e74a1dc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b89414-accb-4705-abbb-05429561fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:54 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Volume 58bf820d-875c-4242-bf85-d8cb80e81319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58bf820d-875c-4242-bf85-d8cb80e81319', 'volume_size': 1} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-387087521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bf820d-875c-4242-bf85-d8cb80e81319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021b55736a442e8ad617de8ef90605f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:54Z,use_quota=True,user_id='e7b802c06ea341908ed450b42538e866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Creating volume 58bf820d-875c-4242-bf85-d8cb80e81319 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:54 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:54 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 1073741824 Nov 05 12:07:54 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:55 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 1073741824" returned: 0 in 1.030s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:55 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 Nov 05 12:07:55 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Flow 'volume_create_manager' (3afcfa8a-dbab-4302-b8a2-093cb1db16be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8afaf4-8b5b-4db8-a336-002c846954a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8afaf4-8b5b-4db8-a336-002c846954a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065116581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe452c50-2fc4-4b69-89fe-7e0b092822e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0f4fa13cc14ae294ba40999587040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:56Z,use_quota=True,user_id='55adcee3176546e6b628d268d3d43be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf7956b-8720-44bc-823b-1ce8b0f12381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf7956b-8720-44bc-823b-1ce8b0f12381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ceb6328-9efe-4aa7-b02d-777f71f4639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ceb6328-9efe-4aa7-b02d-777f71f4639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe452c50-2fc4-4b69-89fe-7e0b092822e1', 'volume_name': 'volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2257ca2a-abf9-4636-bc94-d0420cfa8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2257ca2a-abf9-4636-bc94-d0420cfa8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b646e0c-f277-4f8a-9678-e9b20be53a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:56 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Volume fe452c50-2fc4-4b69-89fe-7e0b092822e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1', 'volume_size': 1} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:56 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319" returned: 0 in 0.569s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065116581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe452c50-2fc4-4b69-89fe-7e0b092822e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0f4fa13cc14ae294ba40999587040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:56Z,use_quota=True,user_id='55adcee3176546e6b628d268d3d43be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Creating volume fe452c50-2fc4-4b69-89fe-7e0b092822e1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:07:56 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:56 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 1073741824 Nov 05 12:07:56 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b89414-accb-4705-abbb-05429561fabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58bf820d-875c-4242-bf85-d8cb80e81319', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c02d7d2-f0ec-4e50-bafc-c72f67369682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:56 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Volume volume-58bf820d-875c-4242-bf85-d8cb80e81319 (58bf820d-875c-4242-bf85-d8cb80e81319): created successfully Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c02d7d2-f0ec-4e50-bafc-c72f67369682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Flow 'volume_create_manager' (d3a7aa46-ab51-45b2-8fbe-224835c88444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:56 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b7442d5f-c794-449f-9623-70f0a906a190 tempest-VolumesTransfersV355Test-1031125183 None] Created volume successfully. Nov 05 12:07:57 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 1073741824" returned: 0 in 0.838s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:57 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 Nov 05 12:07:57 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:07:57 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1" returned: 0 in 0.524s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b646e0c-f277-4f8a-9678-e9b20be53a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed724810-2f34-4864-9312-73050391e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:07:57 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Volume volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 (fe452c50-2fc4-4b69-89fe-7e0b092822e1): created successfully Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed724810-2f34-4864-9312-73050391e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:07:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Flow 'volume_create_manager' (3afcfa8a-dbab-4302-b8a2-093cb1db16be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:07:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-612d1794-19a9-425e-872f-58bfb0770ac7 tempest-ProjectReaderTests-1743728088 None] Created volume successfully. Nov 05 12:07:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-25fa2150-61d2-45f7-bd27-494d3f619ad8 tempest-VolumesTransfersV355Test-917442669 None] Transfer volume completed successfully. Nov 05 12:07:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "cinder-fe452c50-2fc4-4b69-89fe-7e0b092822e1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-fe452c50-2fc4-4b69-89fe-7e0b092822e1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "cinder-quobyte-fe452c50-2fc4-4b69-89fe-7e0b092822e1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:07:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-quobyte-fe452c50-2fc4-4b69-89fe-7e0b092822e1" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:07:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65a1c47-57a3-47b4-b519-6734563e194e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:07:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:07:59 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 Nov 05 12:07:59 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:00 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1" returned: 0 in 0.838s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:00 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1 Nov 05 12:08:00 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Acquiring lock "cinder-58bf820d-875c-4242-bf85-d8cb80e81319-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-58bf820d-875c-4242-bf85-d8cb80e81319-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Acquiring lock "cinder-quobyte-58bf820d-875c-4242-bf85-d8cb80e81319" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-quobyte-58bf820d-875c-4242-bf85-d8cb80e81319" acquired by "delete_volume" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ad195-e949-47ef-9c68-b0c0459cbc3d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:00 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe452c50-2fc4-4b69-89fe-7e0b092822e1" returned: 0 in 0.521s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-quobyte-fe452c50-2fc4-4b69-89fe-7e0b092822e1" released by "delete_volume" :: held 1.444s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:00 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 Nov 05 12:08:00 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Created reservations ['a4c9adda-4cd0-4f3e-bca3-4e80fb437cda', 'ee6f89db-d4e8-48ce-b9ed-eee2ecf4eb2c', 'b0acb82d-46fd-4a37-a9e9-56a60dbad53e', '6d34a728-d06f-43ac-8572-b8e5ffb70000'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:00 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:00 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:01 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319" returned: 0 in 0.646s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:01 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319 Nov 05 12:08:01 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:01 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.665s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:01 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Deleted volume successfully. Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7cdff443-fa82-4a3d-8a84-9d54d3657aa8 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-fe452c50-2fc4-4b69-89fe-7e0b092822e1-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:01 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58bf820d-875c-4242-bf85-d8cb80e81319" returned: 0 in 0.669s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-quobyte-58bf820d-875c-4242-bf85-d8cb80e81319" released by "delete_volume" :: held 1.409s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Created reservations ['aaffdb69-391b-4563-a97f-837e2b40d9e8', '3e1da9bc-0747-4674-9493-0bfb61b73063', '2628a9e1-bc77-4997-a60a-2618212c59f0', 'dcf1ff51-d474-4c20-9038-30e3da7426d3'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:02 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:02 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Flow 'volume_create_manager' (d3406200-df54-47e4-8371-3cb43a729388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0386ba-74c5-4d77-90de-6374d0254390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0386ba-74c5-4d77-90de-6374d0254390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623846686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9d291d-4cbb-449d-94cb-7b9823475d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0f4fa13cc14ae294ba40999587040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:02Z,use_quota=True,user_id='55adcee3176546e6b628d268d3d43be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96613da3-342e-45fd-8bd2-362c0ea55c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96613da3-342e-45fd-8bd2-362c0ea55c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:02 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad9992e-5d4d-491e-af9e-b97fc09f46c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad9992e-5d4d-491e-af9e-b97fc09f46c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9d291d-4cbb-449d-94cb-7b9823475d70', 'volume_name': 'volume-1c9d291d-4cbb-449d-94cb-7b9823475d70', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2cf52f-a4c3-49ce-b232-c3a644a15dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2cf52f-a4c3-49ce-b232-c3a644a15dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286be004-10a3-4dbf-bc44-9816baa03188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:02 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Volume 1c9d291d-4cbb-449d-94cb-7b9823475d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9d291d-4cbb-449d-94cb-7b9823475d70', 'volume_size': 1} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623846686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9d291d-4cbb-449d-94cb-7b9823475d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0f4fa13cc14ae294ba40999587040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:02Z,use_quota=True,user_id='55adcee3176546e6b628d268d3d43be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Creating volume 1c9d291d-4cbb-449d-94cb-7b9823475d70 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:02 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.591s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Deleted volume successfully. Nov 05 12:08:02 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 1073741824 Nov 05 12:08:02 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-16296850-3e28-4806-8151-80cec2ea5047 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-58bf820d-875c-4242-bf85-d8cb80e81319-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:03 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 1073741824" returned: 0 in 0.794s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:03 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 Nov 05 12:08:03 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Flow 'volume_create_manager' (cdf8032c-6fe1-48c6-87ef-e5888419cc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c2a253-0063-41c0-aa23-ad90e0216f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:03 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286be004-10a3-4dbf-bc44-9816baa03188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9d291d-4cbb-449d-94cb-7b9823475d70', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c80172-d773-4e7c-998c-04269ce240d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c2a253-0063-41c0-aa23-ad90e0216f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-147800846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd42703e-1912-4435-b55a-1e0492a2f677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021b55736a442e8ad617de8ef90605f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:04Z,use_quota=True,user_id='e7b802c06ea341908ed450b42538e866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9635bd0f-2202-4b77-baa5-209f32d73e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9635bd0f-2202-4b77-baa5-209f32d73e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3da1133-5df6-4fc4-9a49-ebe24fc053db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3da1133-5df6-4fc4-9a49-ebe24fc053db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd42703e-1912-4435-b55a-1e0492a2f677', 'volume_name': 'volume-cd42703e-1912-4435-b55a-1e0492a2f677', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958a4078-ac1f-4096-aea5-68a68f72141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958a4078-ac1f-4096-aea5-68a68f72141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeaecaf-6ea3-4b6d-80f1-bd4f6742662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Volume cd42703e-1912-4435-b55a-1e0492a2f677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd42703e-1912-4435-b55a-1e0492a2f677', 'volume_size': 1} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-147800846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd42703e-1912-4435-b55a-1e0492a2f677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021b55736a442e8ad617de8ef90605f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:04Z,use_quota=True,user_id='e7b802c06ea341908ed450b42538e866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Creating volume cd42703e-1912-4435-b55a-1e0492a2f677 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:03 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Volume volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 (1c9d291d-4cbb-449d-94cb-7b9823475d70): created successfully Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c80172-d773-4e7c-998c-04269ce240d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Flow 'volume_create_manager' (d3406200-df54-47e4-8371-3cb43a729388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:04 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 1073741824 Nov 05 12:08:04 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-537370c0-81ce-43bc-945e-ee95b7ca53da tempest-ProjectReaderTests-1743728088 None] Created volume successfully. Nov 05 12:08:04 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 1073741824" returned: 0 in 0.607s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:04 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 Nov 05 12:08:04 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "cinder-1c9d291d-4cbb-449d-94cb-7b9823475d70-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-1c9d291d-4cbb-449d-94cb-7b9823475d70-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "cinder-quobyte-1c9d291d-4cbb-449d-94cb-7b9823475d70" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-quobyte-1c9d291d-4cbb-449d-94cb-7b9823475d70" acquired by "delete_volume" :: waited 0.040s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[384318a7-d0e4-4f7a-a796-896340bd9c87]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:05 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeaecaf-6ea3-4b6d-80f1-bd4f6742662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd42703e-1912-4435-b55a-1e0492a2f677', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ed4ba6-d829-424f-a82c-29bca85a9062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Volume volume-cd42703e-1912-4435-b55a-1e0492a2f677 (cd42703e-1912-4435-b55a-1e0492a2f677): created successfully Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ed4ba6-d829-424f-a82c-29bca85a9062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:05 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 Nov 05 12:08:05 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Flow 'volume_create_manager' (cdf8032c-6fe1-48c6-87ef-e5888419cc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-87c4c3e5-f6b9-4a79-a277-6210f37ee305 tempest-VolumesTransfersV355Test-1031125183 None] Created volume successfully. Nov 05 12:08:05 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70" returned: 0 in 0.508s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:05 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70 Nov 05 12:08:05 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:05 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1c9d291d-4cbb-449d-94cb-7b9823475d70" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-quobyte-1c9d291d-4cbb-449d-94cb-7b9823475d70" released by "delete_volume" :: held 0.953s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Created reservations ['32af9829-25a2-4da6-9775-25c2f75d4647', '3c3672c6-ebfc-457f-92da-44b419aa0956', 'c918bbdc-a79c-446f-ad22-4939c92e40d4', '023310f4-3b86-43f4-abed-7b0403e8c98b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:06 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:06 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Acquiring lock "cinder-cd42703e-1912-4435-b55a-1e0492a2f677-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-cd42703e-1912-4435-b55a-1e0492a2f677-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Acquiring lock "cinder-quobyte-cd42703e-1912-4435-b55a-1e0492a2f677" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-quobyte-cd42703e-1912-4435-b55a-1e0492a2f677" acquired by "delete_volume" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b79b28-6c57-4a17-8e2d-f4e74732e07f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:06 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.327s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Deleted volume successfully. Nov 05 12:08:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-976bb170-2fce-4f5a-b921-472ff37f4862 tempest-ProjectReaderTests-1743728088 None] Lock "cinder-1c9d291d-4cbb-449d-94cb-7b9823475d70-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:06 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 Nov 05 12:08:06 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:07 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677" returned: 0 in 0.579s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:07 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677 Nov 05 12:08:07 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:07 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cd42703e-1912-4435-b55a-1e0492a2f677" returned: 0 in 0.349s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-quobyte-cd42703e-1912-4435-b55a-1e0492a2f677" released by "delete_volume" :: held 1.036s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Created reservations ['80449de6-68ee-4b72-80c2-bde8bc58e797', '1b722160-db1b-451a-aa2e-cc11327f4ef8', '9ff0a89f-89ea-4981-85e6-901d82d76958', 'fb3ec221-c690-41cc-83b6-91e594643667'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:07 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:07 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:08 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.337s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:08 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Deleted volume successfully. Nov 05 12:08:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0b1a64df-6214-49b4-8970-e44b49c11d31 tempest-VolumesTransfersV355Test-1663533559 None] Lock "cinder-cd42703e-1912-4435-b55a-1e0492a2f677-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:17 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=24,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:08:18 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=34,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Flow 'volume_create_manager' (a8eac07a-afe2-4463-aa44-7a7e4e6e21c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35562443-d844-4b01-a1af-646da6905d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35562443-d844-4b01-a1af-646da6905d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-124456705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7988683c-dad6-4eed-a5f6-f4652ef95a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef438da9efa41bd9bec94cf8d227120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:21Z,use_quota=True,user_id='bd3d2734e2b9437c9732ae632f1aa3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c433f5-21f9-4f62-bf84-e43d6a90d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c433f5-21f9-4f62-bf84-e43d6a90d621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8b347c-3693-4019-a955-17407cc62fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8b347c-3693-4019-a955-17407cc62fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7988683c-dad6-4eed-a5f6-f4652ef95a4c', 'volume_name': 'volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0228674a-6904-4e24-94b2-52de48f0c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0228674a-6904-4e24-94b2-52de48f0c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a418c3cd-06ed-4271-9f33-8827e8d57619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:20 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Volume 7988683c-dad6-4eed-a5f6-f4652ef95a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c', 'volume_size': 1} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-124456705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7988683c-dad6-4eed-a5f6-f4652ef95a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef438da9efa41bd9bec94cf8d227120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:21Z,use_quota=True,user_id='bd3d2734e2b9437c9732ae632f1aa3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Creating volume 7988683c-dad6-4eed-a5f6-f4652ef95a4c {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:20 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:21 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c 1073741824 Nov 05 12:08:21 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:21 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c 1073741824" returned: 0 in 0.616s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:21 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c Nov 05 12:08:21 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-0ea7be65-3781-4506-884f-a2b592a97b79 req-0d67da52-7c48-414d-8968-d1e52b646386 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:21 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c" returned: 0 in 0.275s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-0ea7be65-3781-4506-884f-a2b592a97b79 req-0d67da52-7c48-414d-8968-d1e52b646386 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.087s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a418c3cd-06ed-4271-9f33-8827e8d57619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b394bce5-892d-419e-96de-988074cbab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-0ea7be65-3781-4506-884f-a2b592a97b79 req-0d67da52-7c48-414d-8968-d1e52b646386 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Volume volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c (7988683c-dad6-4eed-a5f6-f4652ef95a4c): created successfully Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b394bce5-892d-419e-96de-988074cbab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Flow 'volume_create_manager' (a8eac07a-afe2-4463-aa44-7a7e4e6e21c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-df1c439a-b359-46f1-a4f9-b5c387c5485e tempest-VolumesTransfersV357Test-954743614 None] Created volume successfully. Nov 05 12:08:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-0ea7be65-3781-4506-884f-a2b592a97b79 req-0d67da52-7c48-414d-8968-d1e52b646386 tempest-TestInstancesWithCinderVolumes-1097274233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-01e5516d-ec2d-4052-8b88-fc746c8b6396', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afe66fed-6579-4c7f-b4fe-48312732f6c2', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:08:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-0ea7be65-3781-4506-884f-a2b592a97b79 req-0d67da52-7c48-414d-8968-d1e52b646386 tempest-TestInstancesWithCinderVolumes-1097274233 None] attachment_update completed successfully. Nov 05 12:08:23 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fd1aafd2-666b-4bbe-b54f-a406e32eecb3 tempest-VolumesTransfersV357Test-1402326450 None] Transfer volume completed successfully. Nov 05 12:08:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Acquiring lock "cinder-7988683c-dad6-4eed-a5f6-f4652ef95a4c-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-7988683c-dad6-4eed-a5f6-f4652ef95a4c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Acquiring lock "cinder-quobyte-7988683c-dad6-4eed-a5f6-f4652ef95a4c" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-quobyte-7988683c-dad6-4eed-a5f6-f4652ef95a4c" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:24 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22d7ff7-be0d-40f4-b9db-bb527376fb4c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:24 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c Nov 05 12:08:24 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-72c2fb02-2088-4ca5-80d9-2d6c3772f91b req-be4c7e71-a196-4688-a6d6-abb4558d5e65 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-72c2fb02-2088-4ca5-80d9-2d6c3772f91b req-be4c7e71-a196-4688-a6d6-abb4558d5e65 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-72c2fb02-2088-4ca5-80d9-2d6c3772f91b req-be4c7e71-a196-4688-a6d6-abb4558d5e65 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:25 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c" returned: 0 in 0.439s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-72c2fb02-2088-4ca5-80d9-2d6c3772f91b req-be4c7e71-a196-4688-a6d6-abb4558d5e65 tempest-TestInstancesWithCinderVolumes-1097274233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b926f23a-2cc9-40d6-a4c6-f85954f88779', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:08:25 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c Nov 05 12:08:25 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:25 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-72c2fb02-2088-4ca5-80d9-2d6c3772f91b req-be4c7e71-a196-4688-a6d6-abb4558d5e65 tempest-TestInstancesWithCinderVolumes-1097274233 None] attachment_update completed successfully. Nov 05 12:08:25 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7988683c-dad6-4eed-a5f6-f4652ef95a4c" returned: 0 in 0.296s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-quobyte-7988683c-dad6-4eed-a5f6-f4652ef95a4c" released by "delete_volume" :: held 0.796s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Created reservations ['87fbf838-b009-435d-893b-d1b24694dc34', 'de4d06fa-bb8e-4966-8800-d0b88ce34dd1', '8647252f-6812-4896-aeeb-10651efcf16b', '20be2661-d79c-48c3-8b61-4ba0c6e043e5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:25 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:25 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:25 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.339s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:25 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Deleted volume successfully. Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e326296a-e187-4f9d-b8d7-d3312ce61f23 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-7988683c-dad6-4eed-a5f6-f4652ef95a4c-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Flow 'volume_create_manager' (18259194-93fa-42e0-a8e1-b38bd2b8d755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571bcf74-8d77-4570-ab55-595b660744a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571bcf74-8d77-4570-ab55-595b660744a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-369057530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f804264-ca99-4fb3-b8b1-88915f9a23b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef438da9efa41bd9bec94cf8d227120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:26Z,use_quota=True,user_id='bd3d2734e2b9437c9732ae632f1aa3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0a7828-866e-42f7-aaca-2e1fce18d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0a7828-866e-42f7-aaca-2e1fce18d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d3cbcb-1d2b-49fc-8930-cd20ef320c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d3cbcb-1d2b-49fc-8930-cd20ef320c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f804264-ca99-4fb3-b8b1-88915f9a23b3', 'volume_name': 'volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd747d55-6e50-46a3-bc12-7c217126c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd747d55-6e50-46a3-bc12-7c217126c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e648944f-cdaa-4ff6-917a-4a96ed329963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:26 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Volume 7f804264-ca99-4fb3-b8b1-88915f9a23b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3', 'volume_size': 1} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-369057530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f804264-ca99-4fb3-b8b1-88915f9a23b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef438da9efa41bd9bec94cf8d227120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:26Z,use_quota=True,user_id='bd3d2734e2b9437c9732ae632f1aa3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Creating volume 7f804264-ca99-4fb3-b8b1-88915f9a23b3 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:26 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:26 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 1073741824 Nov 05 12:08:26 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:27 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 1073741824" returned: 0 in 0.543s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:27 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 Nov 05 12:08:27 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:27 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3" returned: 0 in 0.296s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e648944f-cdaa-4ff6-917a-4a96ed329963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6d06e8-5983-4877-9fad-7c2b543b246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:27 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Volume volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 (7f804264-ca99-4fb3-b8b1-88915f9a23b3): created successfully Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6d06e8-5983-4877-9fad-7c2b543b246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Flow 'volume_create_manager' (18259194-93fa-42e0-a8e1-b38bd2b8d755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-279d6077-5959-46ff-b7f2-d64a2bfc29ec tempest-VolumesTransfersV357Test-954743614 None] Created volume successfully. Nov 05 12:08:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Acquiring lock "cinder-7f804264-ca99-4fb3-b8b1-88915f9a23b3-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-7f804264-ca99-4fb3-b8b1-88915f9a23b3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Acquiring lock "cinder-quobyte-7f804264-ca99-4fb3-b8b1-88915f9a23b3" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-quobyte-7f804264-ca99-4fb3-b8b1-88915f9a23b3" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8f886-4793-4994-a44d-f5d234cffed9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:29 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 Nov 05 12:08:29 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:29 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3" returned: 0 in 0.428s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:29 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3 Nov 05 12:08:29 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:29 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7f804264-ca99-4fb3-b8b1-88915f9a23b3" returned: 0 in 0.313s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-quobyte-7f804264-ca99-4fb3-b8b1-88915f9a23b3" released by "delete_volume" :: held 0.801s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Created reservations ['3a4bf2cf-6939-4f4f-9c0d-b98d6e94312c', '3c8f6b29-35c4-4eb2-81f7-5671326fa7f6', 'b5fba043-7e34-4dcc-bf49-cb930c44c39a', '0c329863-a54c-47cb-9245-4da57bc9dc85'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:30 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:30 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:30 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.286s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Deleted volume successfully. Nov 05 12:08:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-25e0a645-5603-4568-982c-1ef53942f8d5 tempest-VolumesTransfersV357Test-1124523351 None] Lock "cinder-7f804264-ca99-4fb3-b8b1-88915f9a23b3-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-7be363ad-bebc-4895-be69-e81b6d446c6f req-b9d6e90f-8ae0-40de-8046-1fdd8f3c603e tempest-TestInstancesWithCinderVolumes-1097274233 None] Terminate volume connection completed successfully. Nov 05 12:08:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-7be363ad-bebc-4895-be69-e81b6d446c6f req-b9d6e90f-8ae0-40de-8046-1fdd8f3c603e tempest-TestInstancesWithCinderVolumes-1097274233 None] Deleting attachment afe66fed-6579-4c7f-b4fe-48312732f6c2. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:08:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "cinder-01e5516d-ec2d-4052-8b88-fc746c8b6396-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-01e5516d-ec2d-4052-8b88-fc746c8b6396-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "cinder-quobyte-01e5516d-ec2d-4052-8b88-fc746c8b6396" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-quobyte-01e5516d-ec2d-4052-8b88-fc746c8b6396" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace53850-ccd1-4f0d-8386-52c2397c70bd]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:31 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 Nov 05 12:08:31 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:32 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:32 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396 Nov 05 12:08:32 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:32 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-01e5516d-ec2d-4052-8b88-fc746c8b6396" returned: 0 in 0.343s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-quobyte-01e5516d-ec2d-4052-8b88-fc746c8b6396" released by "delete_volume" :: held 0.954s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:32 devstack cinder-volume[86942]: WARNING cinder.quota [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773837345-863025110 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773837345-863025110, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:08:32 devstack cinder-volume[86942]: WARNING cinder.quota [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773837345-863025110 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773837345-863025110, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Created reservations ['9407d794-e342-4167-b0a8-cc6cf28c6a7a', '4222d88b-b44c-4e70-8640-8b961698534e', 'bb87d51e-8a6f-455e-8619-e031aafdb07a', '93479583-4ae8-430c-8b00-741c8e79b5a4'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:32 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:32 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:33 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.438s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:33 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Deleted volume successfully. Nov 05 12:08:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ef6c654c-1772-488d-b629-a8f6eef85236 tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-01e5516d-ec2d-4052-8b88-fc746c8b6396-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-8b4e76b6-f1ad-4ede-a368-8690c9000e23 req-36393edf-19a1-41e2-9368-7960d5973603 tempest-TestInstancesWithCinderVolumes-1097274233 None] Terminate volume connection completed successfully. Nov 05 12:08:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-8b4e76b6-f1ad-4ede-a368-8690c9000e23 req-36393edf-19a1-41e2-9368-7960d5973603 tempest-TestInstancesWithCinderVolumes-1097274233 None] Deleting attachment b926f23a-2cc9-40d6-a4c6-f85954f88779. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "cinder-8c5584c7-5baa-4e0e-aba7-c9605d6e915c-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-8c5584c7-5baa-4e0e-aba7-c9605d6e915c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "cinder-quobyte-8c5584c7-5baa-4e0e-aba7-c9605d6e915c" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-quobyte-8c5584c7-5baa-4e0e-aba7-c9605d6e915c" acquired by "delete_volume" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[08619622-4372-46d6-b4b5-13991c2c985b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:37 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c Nov 05 12:08:37 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:37 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c" returned: 0 in 0.558s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:37 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c Nov 05 12:08:37 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Flow 'volume_create_manager' (32f664c9-6ec6-455f-91f3-83df04b556d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1354f4-4f28-436c-b75b-83d8c5819588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1354f4-4f28-436c-b75b-83d8c5819588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2003177794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8934f887-9d0e-4ffb-b230-df6883fec103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b392e5fb05a14e7cbc214c7c9d535709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:38Z,use_quota=True,user_id='09f2bc729ea8416792231b4ea62e7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05798c9c-f0f0-4fe3-b47f-22dd77eee295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05798c9c-f0f0-4fe3-b47f-22dd77eee295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3550f83-e805-434f-ab7b-a99a02f1d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3550f83-e805-434f-ab7b-a99a02f1d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8934f887-9d0e-4ffb-b230-df6883fec103', 'volume_name': 'volume-8934f887-9d0e-4ffb-b230-df6883fec103', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb5c880-3633-4b63-afcc-88e7e4680c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb5c880-3633-4b63-afcc-88e7e4680c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70838065-13b4-48f3-a124-d482fa39bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:38 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Volume 8934f887-9d0e-4ffb-b230-df6883fec103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8934f887-9d0e-4ffb-b230-df6883fec103', 'volume_size': 1} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2003177794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8934f887-9d0e-4ffb-b230-df6883fec103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b392e5fb05a14e7cbc214c7c9d535709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:38Z,use_quota=True,user_id='09f2bc729ea8416792231b4ea62e7049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Creating volume 8934f887-9d0e-4ffb-b230-df6883fec103 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:38 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:38 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 1073741824 Nov 05 12:08:38 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:38 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8c5584c7-5baa-4e0e-aba7-c9605d6e915c" returned: 0 in 0.298s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-quobyte-8c5584c7-5baa-4e0e-aba7-c9605d6e915c" released by "delete_volume" :: held 0.922s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:38 devstack cinder-volume[86942]: WARNING cinder.quota [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391220171-944350194 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391220171-944350194, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:08:38 devstack cinder-volume[86942]: WARNING cinder.quota [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391220171-944350194 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391220171-944350194, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Created reservations ['dbe850c5-0806-4b3c-8d06-d254ab2d4809', '3791c7d1-24a5-4817-9087-073a5a0f426b', 'fe86ec77-c424-4b09-828a-661c79ad2af5', '0de9f78f-fa8b-41ba-bc3a-1bf4a77a72df'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:38 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:38 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:38 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 1073741824" returned: 0 in 0.676s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:38 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.417s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Deleted volume successfully. Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-95126044-66b7-4f8e-8e82-e9f0dfbebc5d tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-8c5584c7-5baa-4e0e-aba7-c9605d6e915c-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:38 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 Nov 05 12:08:38 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Flow 'volume_create_manager' (ab5975a1-f4fa-4bc3-a74e-8474f0b3a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6004856-3822-44e3-8620-5d7b5c3ecea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6004856-3822-44e3-8620-5d7b5c3ecea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-444736568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9198cdc2-9b7a-49d6-bc26-f84a480c16c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d003125a744d92aad38db1e7f0f42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:39Z,use_quota=True,user_id='d3293eaab2254e5386e5dd69a6b37a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdd9152-5b2e-46d8-ad1c-5c59f3aad735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdd9152-5b2e-46d8-ad1c-5c59f3aad735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fc16b5-0a86-4f1f-bf83-0642901913a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fc16b5-0a86-4f1f-bf83-0642901913a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9198cdc2-9b7a-49d6-bc26-f84a480c16c1', 'volume_name': 'volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91bff93-9537-4d5d-867a-8aa8ee5b32ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91bff93-9537-4d5d-867a-8aa8ee5b32ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee048b7-10f2-45be-ae4e-2d999dd2b583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:39 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Volume 9198cdc2-9b7a-49d6-bc26-f84a480c16c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1', 'volume_size': 1} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:39 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103" returned: 0 in 0.351s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-444736568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9198cdc2-9b7a-49d6-bc26-f84a480c16c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d003125a744d92aad38db1e7f0f42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:39Z,use_quota=True,user_id='d3293eaab2254e5386e5dd69a6b37a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Creating volume 9198cdc2-9b7a-49d6-bc26-f84a480c16c1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:39 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70838065-13b4-48f3-a124-d482fa39bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8934f887-9d0e-4ffb-b230-df6883fec103', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:39 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 1073741824 Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc13d4-bcfd-4a09-b646-8cc7c90e282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:39 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:39 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Volume volume-8934f887-9d0e-4ffb-b230-df6883fec103 (8934f887-9d0e-4ffb-b230-df6883fec103): created successfully Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc13d4-bcfd-4a09-b646-8cc7c90e282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Flow 'volume_create_manager' (32f664c9-6ec6-455f-91f3-83df04b556d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:39 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a8dd4d35-6041-4ebe-a3e7-70ba98d9e420 tempest-AbsoluteLimitsTests-974694710 None] Created volume successfully. Nov 05 12:08:39 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 1073741824" returned: 0 in 0.733s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:40 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 Nov 05 12:08:40 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:40 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1" returned: 0 in 0.311s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee048b7-10f2-45be-ae4e-2d999dd2b583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32c61a1-ae69-4d13-82c7-fc53f7e4bf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:40 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Volume volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 (9198cdc2-9b7a-49d6-bc26-f84a480c16c1): created successfully Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32c61a1-ae69-4d13-82c7-fc53f7e4bf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Flow 'volume_create_manager' (ab5975a1-f4fa-4bc3-a74e-8474f0b3a707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Acquiring lock "cinder-8934f887-9d0e-4ffb-b230-df6883fec103-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:40 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-14d59dd7-97d4-41ea-ba65-e1e81077f4b9 tempest-VolumesListTestJSON-199090402 None] Created volume successfully. Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Lock "cinder-8934f887-9d0e-4ffb-b230-df6883fec103-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Acquiring lock "cinder-quobyte-8934f887-9d0e-4ffb-b230-df6883fec103" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Lock "cinder-quobyte-8934f887-9d0e-4ffb-b230-df6883fec103" acquired by "delete_volume" :: waited 0.037s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ff6bed-d96e-4cd5-b156-4747427fc947]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:40 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 Nov 05 12:08:40 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:41 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103" returned: 0 in 0.489s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:41 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103 Nov 05 12:08:41 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:41 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8934f887-9d0e-4ffb-b230-df6883fec103" returned: 0 in 0.612s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Lock "cinder-quobyte-8934f887-9d0e-4ffb-b230-df6883fec103" released by "delete_volume" :: held 1.175s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Created reservations ['1e3fd675-143a-4bb5-a202-a0e475f56daa', 'd0a14fa4-0837-49c6-a7ef-476309980ac1', '09c31ed7-4a2f-4c49-bbb1-e03cbe27f88b', 'e4897d37-bdff-4dc5-8b4b-f122245eb990'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:41 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:41 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Flow 'volume_create_manager' (973b9594-b054-4fce-9e19-5fd76dc3e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4835cb25-9588-4c2d-87dd-5ab724f52a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4835cb25-9588-4c2d-87dd-5ab724f52a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1746129261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71749355-d14f-4f09-9167-735c18063ca8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d003125a744d92aad38db1e7f0f42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:42Z,use_quota=True,user_id='d3293eaab2254e5386e5dd69a6b37a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6de95b7-ed48-4b8b-85ac-a41418b430c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6de95b7-ed48-4b8b-85ac-a41418b430c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38264d46-9997-41dc-b7f9-b4f46d761365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38264d46-9997-41dc-b7f9-b4f46d761365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71749355-d14f-4f09-9167-735c18063ca8', 'volume_name': 'volume-71749355-d14f-4f09-9167-735c18063ca8', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907b9f67-dfaf-440d-a1a7-8f01696341e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907b9f67-dfaf-440d-a1a7-8f01696341e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e0145d-fd16-437a-a1e5-d97a4ec4f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Volume 71749355-d14f-4f09-9167-735c18063ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71749355-d14f-4f09-9167-735c18063ca8', 'volume_size': 1} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1746129261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71749355-d14f-4f09-9167-735c18063ca8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d003125a744d92aad38db1e7f0f42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:42Z,use_quota=True,user_id='d3293eaab2254e5386e5dd69a6b37a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Creating volume 71749355-d14f-4f09-9167-735c18063ca8 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:42 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:42 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.376s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Deleted volume successfully. Nov 05 12:08:42 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 1073741824 Nov 05 12:08:42 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-df95dac3-58cc-4311-8716-acf7119e6d1f tempest-AbsoluteLimitsTests-974694710 None] Lock "cinder-8934f887-9d0e-4ffb-b230-df6883fec103-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-8c572096-b930-4c80-a05e-445fa473e55b req-5a4bfb02-506c-4c9a-8718-360250c4c08c tempest-TestInstancesWithCinderVolumes-1097274233 None] Terminate volume connection completed successfully. Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-8c572096-b930-4c80-a05e-445fa473e55b req-5a4bfb02-506c-4c9a-8718-360250c4c08c tempest-TestInstancesWithCinderVolumes-1097274233 None] Deleting attachment a82fb523-6b24-4a66-a504-c3a6dc3e61a5. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:08:42 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 1073741824" returned: 0 in 0.709s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:43 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 Nov 05 12:08:43 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:43 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8" returned: 0 in 0.305s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e0145d-fd16-437a-a1e5-d97a4ec4f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71749355-d14f-4f09-9167-735c18063ca8', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8d209b-105b-40c8-a3d9-26aff82967b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:43 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Volume volume-71749355-d14f-4f09-9167-735c18063ca8 (71749355-d14f-4f09-9167-735c18063ca8): created successfully Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8d209b-105b-40c8-a3d9-26aff82967b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Flow 'volume_create_manager' (973b9594-b054-4fce-9e19-5fd76dc3e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fdb46edf-94ee-4102-8ee0-77044e2355d6 tempest-VolumesListTestJSON-199090402 None] Created volume successfully. Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "cinder-d84ef485-f9ef-4c1b-af3f-d055e3920964-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-d84ef485-f9ef-4c1b-af3f-d055e3920964-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "cinder-quobyte-d84ef485-f9ef-4c1b-af3f-d055e3920964" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-quobyte-d84ef485-f9ef-4c1b-af3f-d055e3920964" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b95a9f9-0d92-4087-b54b-1590f9f55f65]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:43 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 Nov 05 12:08:43 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:44 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964" returned: 0 in 0.454s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:44 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964 Nov 05 12:08:44 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:44 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d84ef485-f9ef-4c1b-af3f-d055e3920964" returned: 0 in 0.310s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-quobyte-d84ef485-f9ef-4c1b-af3f-d055e3920964" released by "delete_volume" :: held 0.820s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:44 devstack cinder-volume[86942]: WARNING cinder.quota [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-653508079-1201610950 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-653508079-1201610950, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:08:44 devstack cinder-volume[86942]: WARNING cinder.quota [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-653508079-1201610950 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-653508079-1201610950, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Created reservations ['95c573c0-b3eb-4bd8-af21-010291972344', '98a4e862-95e2-4191-bd44-3b41cedd5ff2', 'f0f48a77-b791-4ab7-9528-cab59bbfd7cc', 'e77b4c6b-a0f1-43f1-a8fe-8dec79ff0e17'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:44 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:44 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Flow 'volume_create_manager' (872cc3ae-9cbe-465b-9b4f-e60c454a824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9c8a6-e3c4-45a7-8505-c2e853bb9c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9c8a6-e3c4-45a7-8505-c2e853bb9c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-614535662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d22da0-b1c5-4080-b909-22a03be7f206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d003125a744d92aad38db1e7f0f42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:45Z,use_quota=True,user_id='d3293eaab2254e5386e5dd69a6b37a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae062513-1719-4bfa-bbdb-63c23f8303fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae062513-1719-4bfa-bbdb-63c23f8303fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39adcd9c-5887-410c-b263-d78d93efb1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39adcd9c-5887-410c-b263-d78d93efb1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d22da0-b1c5-4080-b909-22a03be7f206', 'volume_name': 'volume-46d22da0-b1c5-4080-b909-22a03be7f206', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663d43c1-5727-4a4e-94d3-29c16443793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663d43c1-5727-4a4e-94d3-29c16443793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9d3045-1e96-4b75-9f3b-40f02e89d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:44 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Volume 46d22da0-b1c5-4080-b909-22a03be7f206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d22da0-b1c5-4080-b909-22a03be7f206', 'volume_size': 1} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-614535662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d22da0-b1c5-4080-b909-22a03be7f206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d003125a744d92aad38db1e7f0f42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:45Z,use_quota=True,user_id='d3293eaab2254e5386e5dd69a6b37a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Creating volume 46d22da0-b1c5-4080-b909-22a03be7f206 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:44 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:45 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 1073741824 Nov 05 12:08:45 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:45 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.357s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:45 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Deleted volume successfully. Nov 05 12:08:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d7712d80-7c14-4792-8a00-16d89ec83b4f tempest-TestInstancesWithCinderVolumes-1097274233 None] Lock "cinder-d84ef485-f9ef-4c1b-af3f-d055e3920964-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:45 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 1073741824" returned: 0 in 0.705s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:45 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 Nov 05 12:08:45 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:46 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206" returned: 0 in 0.293s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9d3045-1e96-4b75-9f3b-40f02e89d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d22da0-b1c5-4080-b909-22a03be7f206', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12df2d9-5412-41d6-953f-c8912c312a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Volume volume-46d22da0-b1c5-4080-b909-22a03be7f206 (46d22da0-b1c5-4080-b909-22a03be7f206): created successfully Nov 05 12:08:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12df2d9-5412-41d6-953f-c8912c312a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Flow 'volume_create_manager' (872cc3ae-9cbe-465b-9b4f-e60c454a824f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5e9af9f9-8850-4f21-8aa0-d8e4460ac22d tempest-VolumesListTestJSON-199090402 None] Created volume successfully. Nov 05 12:08:48 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Flow 'volume_create_manager' (d24d42e0-df60-4c8a-92ea-127bf0d852ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb0605b-6acd-4aca-8b2a-952d29b321e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb0605b-6acd-4aca-8b2a-952d29b321e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-876750695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463422ba-5ecc-46ab-9ee2-22d1dd04c679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb5a65ddf084c099bb6fa876d5ce7b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:49Z,use_quota=True,user_id='093219c849e649ab8a8a6cdd751b66b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfde2efb-abfc-43f8-8557-cf2005b911c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfde2efb-abfc-43f8-8557-cf2005b911c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ee529c-5d51-4cff-8544-91995c8d4ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ee529c-5d51-4cff-8544-91995c8d4ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463422ba-5ecc-46ab-9ee2-22d1dd04c679', 'volume_name': 'volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f130d69-080f-489b-ad18-7a5b2f4c0855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f130d69-080f-489b-ad18-7a5b2f4c0855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dfa6aa-01f7-4601-85cd-613a4a12f2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:49 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Volume 463422ba-5ecc-46ab-9ee2-22d1dd04c679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679', 'volume_size': 1} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-876750695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463422ba-5ecc-46ab-9ee2-22d1dd04c679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb5a65ddf084c099bb6fa876d5ce7b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:49Z,use_quota=True,user_id='093219c849e649ab8a8a6cdd751b66b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Creating volume 463422ba-5ecc-46ab-9ee2-22d1dd04c679 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:49 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:49 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 1073741824 Nov 05 12:08:49 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Acquiring lock "cinder-46d22da0-b1c5-4080-b909-22a03be7f206-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Lock "cinder-46d22da0-b1c5-4080-b909-22a03be7f206-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Acquiring lock "cinder-quobyte-46d22da0-b1c5-4080-b909-22a03be7f206" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Lock "cinder-quobyte-46d22da0-b1c5-4080-b909-22a03be7f206" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[84db4e1f-ea5f-462e-bc39-9884344283ea]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:49 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 Nov 05 12:08:49 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:49 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 1073741824" returned: 0 in 0.520s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:49 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:49 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 Nov 05 12:08:49 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:49 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206 Nov 05 12:08:49 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:49 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679" returned: 0 in 0.308s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:49 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-46d22da0-b1c5-4080-b909-22a03be7f206" returned: 0 in 0.308s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dfa6aa-01f7-4601-85cd-613a4a12f2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa366a0-bbbc-4e72-8fd6-e53a2ba43b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Lock "cinder-quobyte-46d22da0-b1c5-4080-b909-22a03be7f206" released by "delete_volume" :: held 0.798s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:50 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Volume volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 (463422ba-5ecc-46ab-9ee2-22d1dd04c679): created successfully Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa366a0-bbbc-4e72-8fd6-e53a2ba43b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Flow 'volume_create_manager' (d24d42e0-df60-4c8a-92ea-127bf0d852ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e5ee4f97-3463-43db-9991-b0b95451c5f6 tempest-VolumesMetadataTest-516092185 None] Created volume successfully. Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Created reservations ['9c4364de-9abb-45e0-b708-5dd6330055d1', '2397c122-1e7b-4545-9f67-d34389c72db1', '0ca1ca44-d12b-496a-bf82-9aca9fd0449b', '3bdae5a3-fe27-4f2f-8fd3-f2aff6d85919'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:50 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:50 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "cinder-71749355-d14f-4f09-9167-735c18063ca8-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-71749355-d14f-4f09-9167-735c18063ca8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "cinder-quobyte-71749355-d14f-4f09-9167-735c18063ca8" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-quobyte-71749355-d14f-4f09-9167-735c18063ca8" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4242bf1b-9c46-4cc7-b100-9ce79bd00c45]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:50 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Deleted volume successfully. Nov 05 12:08:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c93a7d97-37de-4474-b39f-2fec5219815c tempest-VolumesListTestJSON-199090402 None] Lock "cinder-46d22da0-b1c5-4080-b909-22a03be7f206-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:50 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 Nov 05 12:08:50 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:51 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8" returned: 0 in 0.434s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:51 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8 Nov 05 12:08:51 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:51 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-71749355-d14f-4f09-9167-735c18063ca8" returned: 0 in 0.341s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-quobyte-71749355-d14f-4f09-9167-735c18063ca8" released by "delete_volume" :: held 0.848s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Created reservations ['f6e91996-9e5b-4889-8281-177c975a99a3', '255b2746-3099-481f-8c7f-8cb495e8faa2', 'f6aedc18-ed39-4297-9355-2c5ae622e489', '92acff95-fd0f-44f2-a375-58226378ede1'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:51 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:51 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:52 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.356s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Deleted volume successfully. Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-edf0fa64-a0ef-4a57-bb64-c0e96b67acd0 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-71749355-d14f-4f09-9167-735c18063ca8-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Acquiring lock "cinder-463422ba-5ecc-46ab-9ee2-22d1dd04c679-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Lock "cinder-463422ba-5ecc-46ab-9ee2-22d1dd04c679-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Acquiring lock "cinder-quobyte-463422ba-5ecc-46ab-9ee2-22d1dd04c679" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Lock "cinder-quobyte-463422ba-5ecc-46ab-9ee2-22d1dd04c679" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae9f37-fb2b-44e6-93f3-2288d2a91406]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:52 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 Nov 05 12:08:52 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:52 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:52 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:52 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679" returned: 0 in 0.491s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:52 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "cinder-9198cdc2-9b7a-49d6-bc26-f84a480c16c1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.326s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:52 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679 Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:08:52 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-9198cdc2-9b7a-49d6-bc26-f84a480c16c1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "cinder-quobyte-9198cdc2-9b7a-49d6-bc26-f84a480c16c1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-quobyte-9198cdc2-9b7a-49d6-bc26-f84a480c16c1" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c2fab-86f7-4b91-803a-05b0d3a94e5f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:08:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:53 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 Nov 05 12:08:53 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:53 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-463422ba-5ecc-46ab-9ee2-22d1dd04c679" returned: 0 in 0.356s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Lock "cinder-quobyte-463422ba-5ecc-46ab-9ee2-22d1dd04c679" released by "delete_volume" :: held 0.905s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Created reservations ['d6451ee9-f6fc-4306-b752-49a2fb49502e', 'e27af979-71f1-43f2-afa0-b09481895745', '0cbedbba-7448-4236-ba2b-e709cca23c6e', '3879a46d-55cd-4ab2-8525-0f6606079fe9'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:53 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:53 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:53 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:53 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1 Nov 05 12:08:53 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:53 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.332s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Deleted volume successfully. Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bc11565e-39ab-4dfb-b346-c3da06e2bd3a tempest-VolumesMetadataTest-516092185 None] Lock "cinder-463422ba-5ecc-46ab-9ee2-22d1dd04c679-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:53 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9198cdc2-9b7a-49d6-bc26-f84a480c16c1" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-quobyte-9198cdc2-9b7a-49d6-bc26-f84a480c16c1" released by "delete_volume" :: held 0.912s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:53 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Created reservations ['39b86e10-86cf-4159-904e-1ebfb5b54376', '811387f7-afeb-40f9-ba0a-affba999f405', '3a5ea199-da96-45c1-96b8-a508d221459c', 'a3101823-d6fc-481a-b6ef-ffd6b3ee0914'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:54 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:08:54 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:54 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.277s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:08:54 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Deleted volume successfully. Nov 05 12:08:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-379c57f0-8fd0-4977-91d1-b87ec38bc6a3 tempest-VolumesListTestJSON-199090402 None] Lock "cinder-9198cdc2-9b7a-49d6-bc26-f84a480c16c1-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (77221cac-9b06-4369-86e2-5affe56bd76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2365ae2a-fb08-4e5d-b5d4-57156e7f7fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2365ae2a-fb08-4e5d-b5d4-57156e7f7fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-536029318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb4ef72-6bf6-47f8-84de-0f339c471e84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:59Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0536ba91-a49a-48cb-82d8-a06fb48c10a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0536ba91-a49a-48cb-82d8-a06fb48c10a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4812e5-9460-4f60-b2cd-42181de1def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4812e5-9460-4f60-b2cd-42181de1def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb4ef72-6bf6-47f8-84de-0f339c471e84', 'volume_name': 'volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cebd8a-d7eb-4c0d-9e1f-bd8fbbd42c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cebd8a-d7eb-4c0d-9e1f-bd8fbbd42c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a51054b-e115-4c51-86a1-2d0579054d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:08:59 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Volume 8fb4ef72-6bf6-47f8-84de-0f339c471e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84', 'volume_size': 1} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-536029318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb4ef72-6bf6-47f8-84de-0f339c471e84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:59Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Creating volume 8fb4ef72-6bf6-47f8-84de-0f339c471e84 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:08:59 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:59 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 1073741824 Nov 05 12:08:59 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:08:59 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 1073741824" returned: 0 in 0.547s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:08:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:08:59 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 Nov 05 12:08:59 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:00 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84" returned: 0 in 0.335s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a51054b-e115-4c51-86a1-2d0579054d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b23b3d-3a8f-45ef-8b04-840de96c819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:00 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Volume volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 (8fb4ef72-6bf6-47f8-84de-0f339c471e84): created successfully Nov 05 12:09:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b23b3d-3a8f-45ef-8b04-840de96c819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (77221cac-9b06-4369-86e2-5affe56bd76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d2ca52f3-48da-4242-b1ce-d20675f5caaf tempest-VolumesGetTest-1979664833 None] Created volume successfully. Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (fc324be3-e380-43fc-a776-a6bb1338b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078f9e46-a57d-4ce6-b97e-d2795ff949f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078f9e46-a57d-4ce6-b97e-d2795ff949f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-818370173',display_name='tempest-VolumesGetTest-Volume-152334051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb82d69e-93b5-4d28-88c4-cebbb04e77d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:02Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb092a47-64e4-4f36-b5ac-d6476d5fe1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb092a47-64e4-4f36-b5ac-d6476d5fe1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccbe5fd-b6d2-443e-a0c7-42d2100f5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccbe5fd-b6d2-443e-a0c7-42d2100f5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb82d69e-93b5-4d28-88c4-cebbb04e77d6', 'volume_name': 'volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a1d3bb-8c7e-45f1-849f-3de9c387a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a1d3bb-8c7e-45f1-849f-3de9c387a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c2bb8f-1c84-4164-8e3b-a9a335c5b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:02 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Volume cb82d69e-93b5-4d28-88c4-cebbb04e77d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6', 'volume_size': 1} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-818370173',display_name='tempest-VolumesGetTest-Volume-152334051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb82d69e-93b5-4d28-88c4-cebbb04e77d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:02Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Creating volume cb82d69e-93b5-4d28-88c4-cebbb04e77d6 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:02 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:02 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 1073741824 Nov 05 12:09:02 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:03 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 1073741824" returned: 0 in 0.582s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:03 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 Nov 05 12:09:03 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:03 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6" returned: 0 in 0.318s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c2bb8f-1c84-4164-8e3b-a9a335c5b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfbd436-ce3d-49ed-b376-b2f3a1c043dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Volume volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 (cb82d69e-93b5-4d28-88c4-cebbb04e77d6): created successfully Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfbd436-ce3d-49ed-b376-b2f3a1c043dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (fc324be3-e380-43fc-a776-a6bb1338b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:03 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f01b893f-73e9-4b8f-8f73-36ecd4b62ff5 tempest-VolumesGetTest-1979664833 None] Created volume successfully. Nov 05 12:09:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-cb82d69e-93b5-4d28-88c4-cebbb04e77d6-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Lock "cinder-cb82d69e-93b5-4d28-88c4-cebbb04e77d6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-cb82d69e-93b5-4d28-88c4-cebbb04e77d6" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-cb82d69e-93b5-4d28-88c4-cebbb04e77d6" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ea987f-040b-4ee4-8ae7-7ad0298be42b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:05 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 Nov 05 12:09:05 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:05 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6" returned: 0 in 0.462s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:05 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6 Nov 05 12:09:05 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:05 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb82d69e-93b5-4d28-88c4-cebbb04e77d6" returned: 0 in 0.325s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-cb82d69e-93b5-4d28-88c4-cebbb04e77d6" released by "delete_volume" :: held 0.856s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:05 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Created reservations ['af610f72-3c99-46d9-8f2d-ef777fbcb0ff', '4f49127b-0593-4e26-a774-dc50f56c483c', '10b49e96-be4b-4616-8cb1-3d6cd1b6ebc7', 'd32ae55f-ed81-4500-95d0-acf8d7d4ee16'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:06 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:06 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-8fb4ef72-6bf6-47f8-84de-0f339c471e84-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Lock "cinder-8fb4ef72-6bf6-47f8-84de-0f339c471e84-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-8fb4ef72-6bf6-47f8-84de-0f339c471e84" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-8fb4ef72-6bf6-47f8-84de-0f339c471e84" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f4aa5-467e-419e-99b4-5e8e53add393]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:06 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.364s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Deleted volume successfully. Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a6e26304-7f0f-4be7-a270-2ae3794c6abd tempest-VolumesGetTest-1979664833 None] Lock "cinder-cb82d69e-93b5-4d28-88c4-cebbb04e77d6-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:06 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 Nov 05 12:09:06 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:06 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84" returned: 0 in 0.453s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:06 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84 Nov 05 12:09:06 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:07 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8fb4ef72-6bf6-47f8-84de-0f339c471e84" returned: 0 in 0.345s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-8fb4ef72-6bf6-47f8-84de-0f339c471e84" released by "delete_volume" :: held 0.870s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Created reservations ['c266302a-4240-4ec3-8453-029b4ae513c2', 'f5ce4146-ff77-462c-b827-8f8d475f16a0', 'a96abc95-9416-436b-b7f0-6a8140286ef6', '0ad1ad42-b7bb-4bfe-9679-63ca18bd8366'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:07 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:07 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:07 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.394s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:07 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Deleted volume successfully. Nov 05 12:09:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-79beb964-fb55-4c87-8f4e-d1c73a35f650 tempest-VolumesGetTest-1979664833 None] Lock "cinder-8fb4ef72-6bf6-47f8-84de-0f339c471e84-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (a4f364a8-a478-455e-abe0-dc52bffc4651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e093744-d7a5-4361-ae63-89e2d4ffbf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e093744-d7a5-4361-ae63-89e2d4ffbf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-852345008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740cf5b3-4eab-4ee8-9188-08624a525f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:08Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9899d4d4-a69c-47b3-8acc-7b25ca060368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9899d4d4-a69c-47b3-8acc-7b25ca060368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83731488-316f-4180-84ce-640d8b43039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83731488-316f-4180-84ce-640d8b43039d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740cf5b3-4eab-4ee8-9188-08624a525f78', 'volume_name': 'volume-740cf5b3-4eab-4ee8-9188-08624a525f78', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c0ba5a-e465-4881-8fe7-1dfe5c691c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c0ba5a-e465-4881-8fe7-1dfe5c691c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3433bdd-90da-42a5-8a85-78f331cb386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:08 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Volume 740cf5b3-4eab-4ee8-9188-08624a525f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740cf5b3-4eab-4ee8-9188-08624a525f78', 'volume_size': 1} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-852345008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740cf5b3-4eab-4ee8-9188-08624a525f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:08Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Creating volume 740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:08 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:08 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 1073741824 Nov 05 12:09:08 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:08 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 1073741824" returned: 0 in 0.684s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:08 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 Nov 05 12:09:08 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:09 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78" returned: 0 in 0.304s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3433bdd-90da-42a5-8a85-78f331cb386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740cf5b3-4eab-4ee8-9188-08624a525f78', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7add5882-ca88-4c81-9f59-fc927f4c93be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:09 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Volume volume-740cf5b3-4eab-4ee8-9188-08624a525f78 (740cf5b3-4eab-4ee8-9188-08624a525f78): created successfully Nov 05 12:09:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7add5882-ca88-4c81-9f59-fc927f4c93be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (a4f364a8-a478-455e-abe0-dc52bffc4651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-34a12d83-96dc-4ffa-a356-0d1d2e3187d3 tempest-VolumesGetTest-1979664833 None] Created volume successfully. Nov 05 12:09:10 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (31429098-3303-4d78-bd6d-a327ec1b16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1dfdc8-873e-462e-8c73-d28367d8876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1dfdc8-873e-462e-8c73-d28367d8876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-592573454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c23d3ff-6aa8-409c-b454-a3ae6b913c76,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=740cf5b3-4eab-4ee8-9188-08624a525f78,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:11Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd6ffcc-beb3-4060-87ec-8f9c832252b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd6ffcc-beb3-4060-87ec-8f9c832252b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cab9b8-d0aa-48d4-a6a6-3b90eb44f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cab9b8-d0aa-48d4-a6a6-3b90eb44f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7c23d3ff-6aa8-409c-b454-a3ae6b913c76', 'volume_name': 'volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76', 'volume_size': 1, 'source_volid': '740cf5b3-4eab-4ee8-9188-08624a525f78', 'source_volstatus': 'available'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab416322-4592-465b-8d8a-3e4b25391fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab416322-4592-465b-8d8a-3e4b25391fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e7508a-6048-45a9-871c-f1b47b1f0fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:11 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Volume 7c23d3ff-6aa8-409c-b454-a3ae6b913c76: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76', 'volume_size': 1, 'source_volid': '740cf5b3-4eab-4ee8-9188-08624a525f78', 'source_volstatus': 'available'} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:11 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Cloning volume 740cf5b3-4eab-4ee8-9188-08624a525f78 to volume 7c23d3ff-6aa8-409c-b454-a3ae6b913c76 Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Creating offline snapshot b892028f-1616-47ac-afc5-920ed6c65ca6 of volume 740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d07db59-8706-474f-88f1-83f6f23f72ce]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:11 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 Nov 05 12:09:11 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:11 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78" returned: 0 in 0.558s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:11 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 1G Nov 05 12:09:11 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:12 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 1G" returned: 0 in 0.694s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740cf5b3-4eab-4ee8-9188-08624a525f78 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:12 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740cf5b3-4eab-4ee8-9188-08624a525f78 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 Nov 05 12:09:12 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:12 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740cf5b3-4eab-4ee8-9188-08624a525f78 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6" returned: 0 in 0.433s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:12 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 is being set with open permissions: ugo+rw Nov 05 12:09:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:12 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 Nov 05 12:09:12 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:13 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6" returned: 0 in 0.307s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:13 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.info Nov 05 12:09:13 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (feb3efd4-0dcd-4de0-ac76-cdc286cef26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21845f7-1dca-4f44-b30a-1bdf65115ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21845f7-1dca-4f44-b30a-1bdf65115ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1431184478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc7213a-b3f3-4179-8f9e-3a8da8583a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:13Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686a4bdd-b891-475b-ac50-7056c3862393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686a4bdd-b891-475b-ac50-7056c3862393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22c8886-39fb-42cb-9532-636e4d0ae232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22c8886-39fb-42cb-9532-636e4d0ae232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc7213a-b3f3-4179-8f9e-3a8da8583a0d', 'volume_name': 'volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf50e98-fb65-42e2-a8d9-26f932863a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf50e98-fb65-42e2-a8d9-26f932863a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d226e7-2999-434f-9336-330e42016c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Volume 4fc7213a-b3f3-4179-8f9e-3a8da8583a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d', 'volume_size': 1} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:13 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.info" returned: 0 in 0.289s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:13 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.info is being set with open permissions: ugo+rw Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:13 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.info Nov 05 12:09:13 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:13 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.info" returned: 0 in 0.283s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] snapshot: b892028f-1616-47ac-afc5-920ed6c65ca6, volume: 7c23d3ff-6aa8-409c-b454-a3ae6b913c76, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b3a5f-b9ab-4e4f-ac56-b33dc8bacbaf]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:13 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 Nov 05 12:09:13 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:14 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6" returned: 0 in 0.458s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-740cf5b3-4eab-4ee8-9188-08624a525f78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e5c4db-081e-434f-88bd-0b8b6af97302]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:14 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 Nov 05 12:09:14 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:14 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78" returned: 0 in 0.399s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:09:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:14 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 Nov 05 12:09:14 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:21 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" returned: 0 in 7.203s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:21 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:09:21 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Converted 1024.00 MB image at 142.13 MB/s Nov 05 12:09:21 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 is being set with open permissions: ugo+rw Nov 05 12:09:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:21 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 Nov 05 12:09:21 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:22 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" returned: 0 in 0.266s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" released by "_copy_volume_from_snapshot" :: held 8.409s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=93,cinder:UPDATE=131,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-b892028f-1616-47ac-afc5-920ed6c65ca6" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-b892028f-1616-47ac-afc5-920ed6c65ca6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Deleting offline snapshot b892028f-1616-47ac-afc5-920ed6c65ca6 of volume 740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] snapshot_file for this snap is: volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e47dd-bf2f-41ea-85f9-da9c79eec34f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:22 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 Nov 05 12:09:22 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:22 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6" returned: 0 in 0.380s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-740cf5b3-4eab-4ee8-9188-08624a525f78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f9a9d-e88e-431b-b67b-85c29e12431a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:22 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 Nov 05 12:09:22 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:23 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78" returned: 0 in 0.560s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:23 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 Nov 05 12:09:23 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:23 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=131,cinder:SELECT=110,cinder:INSERT=27,cinder:DELETE=11 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:09:23 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6" returned: 0 in 0.367s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:23 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6 Nov 05 12:09:23 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:23 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78.b892028f-1616-47ac-afc5-920ed6c65ca6" returned: 0 in 0.268s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-b892028f-1616-47ac-afc5-920ed6c65ca6" released by "_delete_snapshot" :: held 1.700s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.958s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.631s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1431184478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc7213a-b3f3-4179-8f9e-3a8da8583a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:13Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Creating volume 4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:24 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:24 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d 1073741824 Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e7508a-6048-45a9-871c-f1b47b1f0fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76', 'volume_size': 1, 'source_volid': '740cf5b3-4eab-4ee8-9188-08624a525f78', 'source_volstatus': 'available'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:24 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb95973-fbcb-4295-89b8-4325da2add53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:24 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Volume volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 (7c23d3ff-6aa8-409c-b454-a3ae6b913c76): created successfully Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb95973-fbcb-4295-89b8-4325da2add53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (31429098-3303-4d78-bd6d-a327ec1b16fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bd211820-f216-47be-b61c-5e0bea48b66f tempest-VolumesGetTest-1979664833 None] Created volume successfully. Nov 05 12:09:24 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d 1073741824" returned: 0 in 0.519s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:24 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d Nov 05 12:09:24 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:24 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" returned: 0 in 0.276s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d226e7-2999-434f-9336-330e42016c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1df523-023f-4aca-8477-712406245224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:24 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Volume volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d (4fc7213a-b3f3-4179-8f9e-3a8da8583a0d): created successfully Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1df523-023f-4aca-8477-712406245224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (feb3efd4-0dcd-4de0-ac76-cdc286cef26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-81d434c7-4b3c-4a75-8f2e-e90aec219d3d tempest-VolumesSnapshotTestJSON-806646738 None] Created volume successfully. Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (28e26158-9543-41c5-acd0-501719fe07ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c836355-47fa-422c-9d9f-dad29d2f21f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c836355-47fa-422c-9d9f-dad29d2f21f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-839663878',display_name='tempest-VolumesGetTest-Volume-825491259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21882b8c-e490-4644-bf8c-8ac1224388c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:26Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c2db9f-b3e4-4255-8a31-c47fbf5608fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c2db9f-b3e4-4255-8a31-c47fbf5608fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d891c7-67f9-4100-8b79-39fbfdd65933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d891c7-67f9-4100-8b79-39fbfdd65933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21882b8c-e490-4644-bf8c-8ac1224388c1', 'volume_name': 'volume-21882b8c-e490-4644-bf8c-8ac1224388c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03441e45-30d6-45c5-85bf-9fb265d1040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03441e45-30d6-45c5-85bf-9fb265d1040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d6e981-156b-4580-beb7-1084351833d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:26 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Volume 21882b8c-e490-4644-bf8c-8ac1224388c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21882b8c-e490-4644-bf8c-8ac1224388c1', 'volume_size': 1} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-839663878',display_name='tempest-VolumesGetTest-Volume-825491259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21882b8c-e490-4644-bf8c-8ac1224388c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:26Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Creating volume 21882b8c-e490-4644-bf8c-8ac1224388c1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:26 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:26 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 1073741824 Nov 05 12:09:26 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:26 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 1073741824" returned: 0 in 0.530s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:26 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 Nov 05 12:09:26 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:27 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1" returned: 0 in 0.313s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.883s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d6e981-156b-4580-beb7-1084351833d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21882b8c-e490-4644-bf8c-8ac1224388c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a28057-6100-47dc-bd01-1e0818f72b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Creating offline snapshot c96e7667-6e2a-485b-a771-30e678437874 of volume 4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:09:27 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Volume volume-21882b8c-e490-4644-bf8c-8ac1224388c1 (21882b8c-e490-4644-bf8c-8ac1224388c1): created successfully Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a28057-6100-47dc-bd01-1e0818f72b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (28e26158-9543-41c5-acd0-501719fe07ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6694c0-b45b-4086-838f-407cd80949d1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-dd2bd670-2f54-44ab-8579-466a7e0b8f6e tempest-VolumesGetTest-1979664833 None] Created volume successfully. Nov 05 12:09:27 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d Nov 05 12:09:27 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:27 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" returned: 0 in 0.482s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:27 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 1G Nov 05 12:09:27 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:28 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 1G" returned: 0 in 0.585s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:28 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 Nov 05 12:09:28 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-21882b8c-e490-4644-bf8c-8ac1224388c1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Lock "cinder-21882b8c-e490-4644-bf8c-8ac1224388c1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-21882b8c-e490-4644-bf8c-8ac1224388c1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-21882b8c-e490-4644-bf8c-8ac1224388c1" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68578b8-be67-4d05-9363-5943420eeb2b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:28 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874" returned: 0 in 0.408s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:28 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 is being set with open permissions: ugo+rw Nov 05 12:09:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:28 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 Nov 05 12:09:28 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:28 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 Nov 05 12:09:28 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:29 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874" returned: 0 in 0.303s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:29 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1" returned: 0 in 0.482s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:29 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1 Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:29 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:29 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.info Nov 05 12:09:29 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:29 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21882b8c-e490-4644-bf8c-8ac1224388c1" returned: 0 in 0.307s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:29 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-21882b8c-e490-4644-bf8c-8ac1224388c1" released by "delete_volume" :: held 0.855s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.info" returned: 0 in 0.310s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:29 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.info is being set with open permissions: ugo+rw Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:29 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.info Nov 05 12:09:29 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Created reservations ['7f0ed3fa-81ea-45ff-9df7-bf5f36195af2', 'e205d0ea-c0fc-4c31-8c3d-a265038d38ab', '6addfc2b-b07d-4bf1-831d-81872ddec9cf', '083e2e16-85ad-4862-a0d4-34aa25b72204'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:29 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:29 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-7c23d3ff-6aa8-409c-b454-a3ae6b913c76-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:29 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.info" returned: 0 in 0.472s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Lock "cinder-7c23d3ff-6aa8-409c-b454-a3ae6b913c76-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" acquired by "delete_volume" :: waited 0.052s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-63030e1a-79ed-406d-ab07-0026e57c160d tempest-VolumesSnapshotTestJSON-806646738 None] Create snapshot completed successfully Nov 05 12:09:30 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[acafa55b-f257-44fd-bb7d-86d9342249be]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.474s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Deleted volume successfully. Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2b592403-c888-40fa-8949-7cee43e07307 tempest-VolumesGetTest-1979664833 None] Lock "cinder-21882b8c-e490-4644-bf8c-8ac1224388c1-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:30 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 Nov 05 12:09:30 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-c96e7667-6e2a-485b-a771-30e678437874-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-c96e7667-6e2a-485b-a771-30e678437874-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-c96e7667-6e2a-485b-a771-30e678437874" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-c96e7667-6e2a-485b-a771-30e678437874" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Deleting offline snapshot c96e7667-6e2a-485b-a771-30e678437874 of volume 4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] snapshot_file for this snap is: volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7c420f-cb80-494f-a077-ade4b0665e82]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:30 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" returned: 0 in 0.496s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:30 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76 Nov 05 12:09:30 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:30 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 Nov 05 12:09:30 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:30 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" returned: 0 in 0.284s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-7c23d3ff-6aa8-409c-b454-a3ae6b913c76" released by "delete_volume" :: held 0.865s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Created reservations ['aacb2734-1a77-4f5e-a324-ef4ae627cfde', '01dcc9cb-0070-44fa-846b-144b6f9bfd40', '3a614f5d-d5cc-4c69-9774-e3e98c98500f', '96beb828-b7e5-456e-99b1-fc94012720eb'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:31 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874" returned: 0 in 0.493s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33e7ed8-f65f-4d37-a4fc-55ece437d3e1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:31 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:31 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:31 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d Nov 05 12:09:31 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Flow 'volume_create_manager' (b123f4b9-b1e2-4c31-a2d7-0293b12b8750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd29aaf-aada-4473-8142-b62b3e8608f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd29aaf-aada-4473-8142-b62b3e8608f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1401874838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1c1c39-bb89-45d8-b864-d1cd8b669ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dd36063aa4412bb12b0a27775533f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:31Z,use_quota=True,user_id='a384d2d0f8584e94ba19db994e807af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf61879-a880-4a95-afd5-409957169a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf61879-a880-4a95-afd5-409957169a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67030ea4-a1bf-47f8-975d-9913587cacfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67030ea4-a1bf-47f8-975d-9913587cacfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1c1c39-bb89-45d8-b864-d1cd8b669ae2', 'volume_name': 'volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd8c25d-5437-4da1-b2b2-434ffb2cd7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd8c25d-5437-4da1-b2b2-434ffb2cd7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e1a8f9-0900-4996-9dc4-b784c0e69a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Volume 4f1c1c39-bb89-45d8-b864-d1cd8b669ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2', 'volume_size': 1} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1401874838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1c1c39-bb89-45d8-b864-d1cd8b669ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dd36063aa4412bb12b0a27775533f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:31Z,use_quota=True,user_id='a384d2d0f8584e94ba19db994e807af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Creating volume 4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:31 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:31 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 1073741824 Nov 05 12:09:31 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:31 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Deleted volume successfully. Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-223068fb-03b7-49e8-9142-3e8fc5732a2f tempest-VolumesGetTest-1979664833 None] Lock "cinder-7c23d3ff-6aa8-409c-b454-a3ae6b913c76-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:31 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" returned: 0 in 0.523s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:31 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 Nov 05 12:09:31 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Flow 'volume_create_manager' (62150dca-f406-4100-9162-7a6d29bc9f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce17df0-6310-43c7-a6d4-4b5cb13c40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce17df0-6310-43c7-a6d4-4b5cb13c40dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-810829068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dd36063aa4412bb12b0a27775533f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:32Z,use_quota=True,user_id='a384d2d0f8584e94ba19db994e807af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7680af6-d9ca-4630-ab16-a1bb2d930355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7680af6-d9ca-4630-ab16-a1bb2d930355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3043e6-a989-4c00-8bc4-25c5034080f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3043e6-a989-4c00-8bc4-25c5034080f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36', 'volume_name': 'volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2733acc2-641b-4db5-bc26-85f2a9a80dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2733acc2-641b-4db5-bc26-85f2a9a80dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8626b80f-812f-4c6e-a25f-255bc6facdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Volume b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36', 'volume_size': 1} Nov 05 12:09:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:32 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 1073741824" returned: 0 in 0.616s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:32 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874" returned: 0 in 0.469s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:32 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 Nov 05 12:09:32 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:32 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874 Nov 05 12:09:32 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-740cf5b3-4eab-4ee8-9188-08624a525f78-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-740cf5b3-4eab-4ee8-9188-08624a525f78-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-740cf5b3-4eab-4ee8-9188-08624a525f78" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-740cf5b3-4eab-4ee8-9188-08624a525f78" acquired by "delete_volume" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb5858-050e-49b2-8dbd-f25e4af56626]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:32 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2" returned: 0 in 0.433s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:32 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 Nov 05 12:09:32 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-810829068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dd36063aa4412bb12b0a27775533f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:32Z,use_quota=True,user_id='a384d2d0f8584e94ba19db994e807af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Creating volume b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:32 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:32 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d.c96e7667-6e2a-485b-a771-30e678437874" returned: 0 in 0.491s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:32 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 1073741824 Nov 05 12:09:32 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e1a8f9-0900-4996-9dc4-b784c0e69a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8228a3c1-d56d-4eba-bbba-2adc75bce8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:32 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Volume volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 (4f1c1c39-bb89-45d8-b864-d1cd8b669ae2): created successfully Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8228a3c1-d56d-4eba-bbba-2adc75bce8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Flow 'volume_create_manager' (b123f4b9-b1e2-4c31-a2d7-0293b12b8750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-c96e7667-6e2a-485b-a771-30e678437874" released by "_delete_snapshot" :: held 2.195s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" released by "delete_snapshot" :: held 2.227s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7a3313d0-64ec-4b8e-bc49-7d2f910a730a tempest-TestServerVolumeAttachmentScenario-163891015 None] Created volume successfully. Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['ca8bc0bb-a51d-45cf-b374-92184330df28', '769561bf-e1e6-4efd-ab81-a3ba5be401f6', '3f9bc03a-a2f0-46bc-995c-476d2557378e', '0b4113ed-bfcb-40f0-961e-2061c0fd2fe6'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:32 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78" returned: 0 in 0.495s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:32 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78 Nov 05 12:09:32 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Delete snapshot completed successfully. Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1597daf3-3c8d-4b10-8266-33ab8342bd29 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-c96e7667-6e2a-485b-a771-30e678437874-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:33 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 1073741824" returned: 0 in 0.558s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:33 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-740cf5b3-4eab-4ee8-9188-08624a525f78" returned: 0 in 0.300s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-740cf5b3-4eab-4ee8-9188-08624a525f78" released by "delete_volume" :: held 0.878s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Created reservations ['8cdd8d4d-7ae4-417b-8823-61b51eb93400', '64a406af-c5ae-4950-b9fe-66626c995f6e', '7268d15a-5915-43b9-9f87-7e1bd9ed69e5', '15056b2c-023e-4ff5-923c-7e6fcada3d10'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:33 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 Nov 05 12:09:33 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:33 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:33 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:33 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36" returned: 0 in 0.302s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8626b80f-812f-4c6e-a25f-255bc6facdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383a10f1-1b3d-43df-b736-90cfa5eac913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Volume volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 (b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36): created successfully Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383a10f1-1b3d-43df-b736-90cfa5eac913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Flow 'volume_create_manager' (62150dca-f406-4100-9162-7a6d29bc9f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b022ab49-81cd-4406-8d96-766192d23ef3 tempest-TestServerVolumeAttachmentScenario-163891015 None] Created volume successfully. Nov 05 12:09:33 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.329s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Deleted volume successfully. Nov 05 12:09:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-73d4c33e-98bc-49f1-bd3d-425e76ebd1f9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-740cf5b3-4eab-4ee8-9188-08624a525f78-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (3f259d6c-8908-452a-9f99-bbc5ce882a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cf0b3d-9cd5-4046-987d-da83e5485ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cf0b3d-9cd5-4046-987d-da83e5485ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-195018509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e41fdd-bfd7-458b-85e6-b64d63db75cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:34Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6696e04d-8f1d-4061-818a-da93ff8566b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6696e04d-8f1d-4061-818a-da93ff8566b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c605bc1-57b1-43b2-a435-e894d14a7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c605bc1-57b1-43b2-a435-e894d14a7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e41fdd-bfd7-458b-85e6-b64d63db75cf', 'volume_name': 'volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3631f96-d382-4daa-83fa-eaaade5e6b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3631f96-d382-4daa-83fa-eaaade5e6b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428cea67-9caa-4c42-bc85-7a0fb4620da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:34 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Volume 80e41fdd-bfd7-458b-85e6-b64d63db75cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf', 'volume_size': 1} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-195018509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e41fdd-bfd7-458b-85e6-b64d63db75cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:34Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Creating volume 80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:34 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:34 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf 1073741824 Nov 05 12:09:34 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:34 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf 1073741824" returned: 0 in 0.556s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:35 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf Nov 05 12:09:35 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:35 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf" returned: 0 in 0.301s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428cea67-9caa-4c42-bc85-7a0fb4620da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff32eb4-f7d5-46ff-93ed-69ebc022367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:35 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Volume volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf (80e41fdd-bfd7-458b-85e6-b64d63db75cf): created successfully Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff32eb4-f7d5-46ff-93ed-69ebc022367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (3f259d6c-8908-452a-9f99-bbc5ce882a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:35 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4a142bf8-ea39-40d1-a67a-4aca986d846e tempest-VolumesSnapshotTestJSON-806646738 None] Created volume successfully. Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (b304a025-40ae-40cc-905a-8923b5c0dc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654bb1b8-6591-4025-b614-e32087c9e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654bb1b8-6591-4025-b614-e32087c9e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-848161599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069ab866-8ce7-421d-8d1b-da0c31784ef9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:36Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c255b31c-9e47-4734-913d-66499b591eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c255b31c-9e47-4734-913d-66499b591eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda32f42-ce73-48cb-aacd-9b0e85b26b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda32f42-ce73-48cb-aacd-9b0e85b26b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '069ab866-8ce7-421d-8d1b-da0c31784ef9', 'volume_name': 'volume-069ab866-8ce7-421d-8d1b-da0c31784ef9', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5058c1e-2dc2-4f0b-b529-e07d44c06c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5058c1e-2dc2-4f0b-b529-e07d44c06c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd5b404-b8e9-4d5f-a79d-44d44f9ea65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:35 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Volume 069ab866-8ce7-421d-8d1b-da0c31784ef9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-069ab866-8ce7-421d-8d1b-da0c31784ef9', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 12:09:35 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Trying to clone 069ab866-8ce7-421d-8d1b-da0c31784ef9 from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:09:36 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Image download 20.69 MB at 20.69 MB/s Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1325d1-1f6b-4de0-a860-fd5a65ebc2f3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:36 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD Nov 05 12:09:36 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Creating offline snapshot 7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 of volume 80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[794d6106-b755-4b85-863d-73e6f70c775a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:36 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:36 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 is fetched for user d07d502e92e6409c9c6f6ee2fb1c1d87. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:09:37 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2bd281-e409-4de2-a446-92b3cdd44340]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:37 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf Nov 05 12:09:37 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:37 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD Nov 05 12:09:37 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:37 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf" returned: 0 in 0.546s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:37 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 1G Nov 05 12:09:37 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:37 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:38 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 1G" returned: 0 in 0.683s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:38 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 Nov 05 12:09:38 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:38 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" returned: 0 in 0.305s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:38 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 is being set with open permissions: ugo+rw Nov 05 12:09:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:38 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 Nov 05 12:09:38 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:38 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" returned: 0 in 0.271s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:38 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.info Nov 05 12:09:38 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:39 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.info" returned: 0 in 0.338s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:39 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.info is being set with open permissions: ugo+rw Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:39 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.info Nov 05 12:09:39 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:39 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.info" returned: 0 in 0.274s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.868s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-848161599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069ab866-8ce7-421d-8d1b-da0c31784ef9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:36Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Creating volume 069ab866-8ce7-421d-8d1b-da0c31784ef9 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:39 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:39 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 1073741824 Nov 05 12:09:39 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:39 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0a3abcce-2182-4226-b301-ee26f4782284 tempest-VolumesSnapshotTestJSON-806646738 None] Create snapshot completed successfully Nov 05 12:09:40 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 1073741824" returned: 0 in 0.829s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:40 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 Nov 05 12:09:40 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:40 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9" returned: 0 in 0.600s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:40 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Attempting download of 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume 069ab866-8ce7-421d-8d1b-da0c31784ef9. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[424f1dbe-2d64-4acd-ae7f-630cefcd87be]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__eb_9u3i {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:41 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__eb_9u3i Nov 05 12:09:41 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (89a37cda-5c9a-46a9-967f-ad01784662f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66501584-4739-4aab-9502-6b6f1fe8c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66501584-4739-4aab-9502-6b6f1fe8c11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-188188825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d61817-589a-494e-8592-44037af56d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:41Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e191ab53-9fee-4e6b-ac14-83d322e39b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e191ab53-9fee-4e6b-ac14-83d322e39b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42945b1a-6ebc-434e-9b95-32f1bc533085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42945b1a-6ebc-434e-9b95-32f1bc533085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58d61817-589a-494e-8592-44037af56d2a', 'volume_name': 'volume-58d61817-589a-494e-8592-44037af56d2a', 'volume_size': 2, 'snapshot_id': '7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c587419-2bf5-45a4-a583-a9985e733bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c587419-2bf5-45a4-a583-a9985e733bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4b206f-957a-4507-877a-cb9663c9ab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Volume 58d61817-589a-494e-8592-44037af56d2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58d61817-589a-494e-8592-44037af56d2a', 'volume_size': 2, 'snapshot_id': '7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0'} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0-58d61817-589a-494e-8592-44037af56d2a" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0-58d61817-589a-494e-8592-44037af56d2a" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Creating volume 58d61817-589a-494e-8592-44037af56d2a from snapshot 7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-58d61817-589a-494e-8592-44037af56d2a" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-58d61817-589a-494e-8592-44037af56d2a" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] snapshot: 7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0, volume: 58d61817-589a-494e-8592-44037af56d2a, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:09:41 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__eb_9u3i" returned: 0 in 0.502s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__eb_9u3i {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[78260e22-d18b-446f-bd4d-4387d4f7f456]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:41 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 Nov 05 12:09:41 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:41 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__eb_9u3i Nov 05 12:09:41 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:42 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__eb_9u3i" returned: 1 in 0.512s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__eb_9u3i' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d8100-7cee-4d36-95be-2d2005fcdf2c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:42 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" returned: 0 in 0.538s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[64272d89-b64e-4a50-899a-ae0686d1a426]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:42 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD Nov 05 12:09:42 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:42 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf Nov 05 12:09:42 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:42 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 was qcow2, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:42 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 Nov 05 12:09:42 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:42 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf" returned: 0 in 0.431s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:09:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:42 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a Nov 05 12:09:42 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:48 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9" returned: 0 in 5.747s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:48 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_rpbqf5i6devstack@QuobyteHD, size 112.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:09:48 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Converted 112.00 MB image at 19.48 MB/s Nov 05 12:09:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:48 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 1G Nov 05 12:09:48 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:48 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 1G" returned: 0 in 0.736s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:48 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Downloaded image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume 069ab866-8ce7-421d-8d1b-da0c31784ef9 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:09:48 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 for user d07d502e92e6409c9c6f6ee2fb1c1d87 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:09:48 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Marking volume 069ab866-8ce7-421d-8d1b-da0c31784ef9 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:09:49 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Copying metadata from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 to 069ab866-8ce7-421d-8d1b-da0c31784ef9. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:09:49 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Creating volume glance metadata for volume 069ab866-8ce7-421d-8d1b-da0c31784ef9 backed by image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:09:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd5b404-b8e9-4d5f-a79d-44d44f9ea65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069ab866-8ce7-421d-8d1b-da0c31784ef9', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51608ba7-8342-42ef-b114-d59e3d0e5248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:49 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Volume volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 (069ab866-8ce7-421d-8d1b-da0c31784ef9): created successfully Nov 05 12:09:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51608ba7-8342-42ef-b114-d59e3d0e5248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (b304a025-40ae-40cc-905a-8923b5c0dc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-37bbc38f-64ad-44a0-8706-cf3a2625633c tempest-VolumesGetTest-1979664833 None] Created volume successfully. Nov 05 12:09:52 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a" returned: 0 in 9.513s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf, size 1024.00 MB, duration 9.51 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:09:52 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Converted 1024.00 MB image at 107.63 MB/s Nov 05 12:09:52 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a is being set with open permissions: ugo+rw Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:52 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a Nov 05 12:09:52 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (d030c48e-c284-4c6b-a09d-ecf73a7542cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194f4ada-c9d2-4abf-b6a4-988290e834e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194f4ada-c9d2-4abf-b6a4-988290e834e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1807004905',display_name='tempest-VolumesGetTest-Volume-963104571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd552c33-50de-456c-89e3-a3ba0ae70b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:52Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf41fba-b685-4f56-82db-22d86ce03f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf41fba-b685-4f56-82db-22d86ce03f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca9cf08-1ef3-422b-b75d-8a036a824f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca9cf08-1ef3-422b-b75d-8a036a824f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd552c33-50de-456c-89e3-a3ba0ae70b74', 'volume_name': 'volume-dd552c33-50de-456c-89e3-a3ba0ae70b74', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2009b0e8-4125-4c76-b1ef-04de963c476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2009b0e8-4125-4c76-b1ef-04de963c476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2757240-0095-4a37-b284-c565e43b5048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Volume dd552c33-50de-456c-89e3-a3ba0ae70b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd552c33-50de-456c-89e3-a3ba0ae70b74', 'volume_size': 1} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:52 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a" returned: 0 in 0.274s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-58d61817-589a-494e-8592-44037af56d2a" released by "_copy_volume_from_snapshot" :: held 10.892s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0-58d61817-589a-494e-8592-44037af56d2a" released by "_create_volume_from_snapshot" :: held 10.983s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.018s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1807004905',display_name='tempest-VolumesGetTest-Volume-963104571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd552c33-50de-456c-89e3-a3ba0ae70b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04b7db6e3764c46bb6c66298bbfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:52Z,use_quota=True,user_id='d07d502e92e6409c9c6f6ee2fb1c1d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Creating volume dd552c33-50de-456c-89e3-a3ba0ae70b74 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:52 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:52 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 1073741824 Nov 05 12:09:52 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4b206f-957a-4507-877a-cb9663c9ab5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d61817-589a-494e-8592-44037af56d2a', 'volume_size': 2, 'snapshot_id': '7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e556ce-fea5-4b7c-bdca-8e2524fce950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:52 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:52 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Volume volume-58d61817-589a-494e-8592-44037af56d2a (58d61817-589a-494e-8592-44037af56d2a): created successfully Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e556ce-fea5-4b7c-bdca-8e2524fce950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (89a37cda-5c9a-46a9-967f-ad01784662f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-860a389e-1ed0-4cd4-a7ff-cddd2a557c00 tempest-VolumesSnapshotTestJSON-806646738 None] Created volume successfully. Nov 05 12:09:52 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:09:52 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 1073741824" returned: 0 in 0.483s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:53 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 Nov 05 12:09:53 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:53 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74" returned: 0 in 0.291s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2757240-0095-4a37-b284-c565e43b5048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd552c33-50de-456c-89e3-a3ba0ae70b74', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd05aa3b-0995-4525-abe8-35ffbcb65950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:53 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Volume volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 (dd552c33-50de-456c-89e3-a3ba0ae70b74): created successfully Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd05aa3b-0995-4525-abe8-35ffbcb65950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Flow 'volume_create_manager' (d030c48e-c284-4c6b-a09d-ecf73a7542cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e357d92d-abd5-447f-aa15-a2652f1a49e3 tempest-VolumesGetTest-1979664833 None] Created volume successfully. Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-58d61817-589a-494e-8592-44037af56d2a-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-58d61817-589a-494e-8592-44037af56d2a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-58d61817-589a-494e-8592-44037af56d2a" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-58d61817-589a-494e-8592-44037af56d2a" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[020110ea-7297-42e0-892c-2997b0990eca]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:53 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a Nov 05 12:09:53 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:54 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a" returned: 0 in 0.455s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:54 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a Nov 05 12:09:54 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-dd552c33-50de-456c-89e3-a3ba0ae70b74-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-dd552c33-50de-456c-89e3-a3ba0ae70b74-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-dd552c33-50de-456c-89e3-a3ba0ae70b74" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-dd552c33-50de-456c-89e3-a3ba0ae70b74" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[469ac5de-a22d-44ce-a88b-d882bd3f5bcd]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:54 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-58d61817-589a-494e-8592-44037af56d2a" returned: 0 in 0.321s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-58d61817-589a-494e-8592-44037af56d2a" released by "delete_volume" :: held 0.827s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:54 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 Nov 05 12:09:54 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['473674e3-41e8-4b5c-af78-17dfdc2efabd', '08d7cfcd-48c5-4d1e-aa31-e9200e22f561', '49b9b1ba-9fa1-4436-84f4-0a311cf97654', '23e5c21b-f40e-483f-87d2-8ab4aa88a78b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:54 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:54 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-80e41fdd-bfd7-458b-85e6-b64d63db75cf" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-80e41fdd-bfd7-458b-85e6-b64d63db75cf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:55 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Deleting offline snapshot 7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 of volume 80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] snapshot_file for this snap is: volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74" returned: 0 in 0.542s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[48457dda-fc83-479a-8054-ed7b04f77263]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:55 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.330s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:55 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74 Nov 05 12:09:55 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Deleted volume successfully. Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0ede745-d6e4-4442-8a63-6eae725ecc83 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-58d61817-589a-494e-8592-44037af56d2a-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:55 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 Nov 05 12:09:55 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:55 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dd552c33-50de-456c-89e3-a3ba0ae70b74" returned: 0 in 0.278s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-dd552c33-50de-456c-89e3-a3ba0ae70b74" released by "delete_volume" :: held 0.875s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Created reservations ['403db692-f2ca-4300-b756-311b0803d322', 'a6629e3a-9f41-469a-81a6-ce62575dcb53', '303e77fc-525e-4009-91c0-36132b5090fc', 'c4cf093b-0f9e-411e-b0bc-1926082598bd'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:55 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" returned: 0 in 0.390s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[06056275-6080-408b-925b-719f11d4b658]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:55 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:55 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:55 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf Nov 05 12:09:55 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-069ab866-8ce7-421d-8d1b-da0c31784ef9-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Lock "cinder-069ab866-8ce7-421d-8d1b-da0c31784ef9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Acquiring lock "cinder-quobyte-069ab866-8ce7-421d-8d1b-da0c31784ef9" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-069ab866-8ce7-421d-8d1b-da0c31784ef9" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[76235f7d-77a2-4672-9974-8375cdab4494]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:55 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.300s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Deleted volume successfully. Nov 05 12:09:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8bb839c7-f58d-4d06-b126-59e713816fc9 tempest-VolumesGetTest-1979664833 None] Lock "cinder-dd552c33-50de-456c-89e3-a3ba0ae70b74-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:55 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 Nov 05 12:09:55 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:56 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf" returned: 0 in 0.596s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:56 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 Nov 05 12:09:56 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:56 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9" returned: 0 in 0.428s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:56 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9 Nov 05 12:09:56 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:56 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-069ab866-8ce7-421d-8d1b-da0c31784ef9" returned: 0 in 0.260s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:56 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Lock "cinder-quobyte-069ab866-8ce7-421d-8d1b-da0c31784ef9" released by "delete_volume" :: held 0.740s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:56 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0 Nov 05 12:09:56 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Created reservations ['9a162fb9-7505-4602-932f-6f6d40361da5', '8ced5b67-cd18-4fe1-ac95-bc210fe2eb46', 'fa659453-0ec1-47bb-a80f-504ba1024ba3', '8a878439-5a11-43f7-9044-878b51bbf262'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:56 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:56 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:56 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf.7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" returned: 0 in 0.253s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0" released by "_delete_snapshot" :: held 1.786s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-80e41fdd-bfd7-458b-85e6-b64d63db75cf" released by "delete_snapshot" :: held 1.812s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['c9e1be34-26a3-4550-8ef1-12db22b01ecd', '41b86627-dd07-4c8d-88d5-b27b5dd9a35e', 'c0bc07ba-47f9-4711-aedb-5498a54221ec', '4fcc4bbb-7dc8-430e-ba4d-94d52095a188'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:56 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.291s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:56 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Deleted volume successfully. Nov 05 12:09:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fc78ddc8-d11d-46e6-b966-1d46cc4a4113 tempest-VolumesGetTest-1979664833 None] Lock "cinder-069ab866-8ce7-421d-8d1b-da0c31784ef9-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Delete snapshot completed successfully. Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3612d12c-49a3-46c7-9a3d-703f1a61f949 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-7faf2ca7-db2a-4c99-b1ee-9b9e7b1d95d0-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-80e41fdd-bfd7-458b-85e6-b64d63db75cf-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-80e41fdd-bfd7-458b-85e6-b64d63db75cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-80e41fdd-bfd7-458b-85e6-b64d63db75cf" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-80e41fdd-bfd7-458b-85e6-b64d63db75cf" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8681ac-9d86-4fd6-98b7-388f64e77ca7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:57 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf Nov 05 12:09:57 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:57 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf" returned: 0 in 0.495s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:57 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf Nov 05 12:09:57 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:58 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-80e41fdd-bfd7-458b-85e6-b64d63db75cf" returned: 0 in 0.291s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-80e41fdd-bfd7-458b-85e6-b64d63db75cf" released by "delete_volume" :: held 0.857s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['5e6fca51-1ba0-4791-b821-ad6c5ddfd80b', '47713bf2-4b5e-4e91-b514-0548f5875f61', '520f3c90-d6f1-478c-9bfa-590f6af3da04', '02a349da-d63f-4c77-8011-9f01adb7d173'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:58 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:09:58 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:58 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.312s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:09:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Deleted volume successfully. Nov 05 12:09:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-09a6d3ae-a54d-450e-9644-217200c1bcf1 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-80e41fdd-bfd7-458b-85e6-b64d63db75cf-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (275605ab-9a54-4894-b5db-cfb20cb28d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a030420-eec2-4e3d-b03d-6a29695d8e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a030420-eec2-4e3d-b03d-6a29695d8e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-462267134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e19594a-0967-4705-a9e9-c919bd9e44d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:59Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036908ca-ff09-4d67-b150-30f65c6684fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036908ca-ff09-4d67-b150-30f65c6684fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f2fd41-f778-4e64-97d1-91486a110912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f2fd41-f778-4e64-97d1-91486a110912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e19594a-0967-4705-a9e9-c919bd9e44d2', 'volume_name': 'volume-1e19594a-0967-4705-a9e9-c919bd9e44d2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceda86a6-5fd4-4fc4-9d54-33820c7de8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceda86a6-5fd4-4fc4-9d54-33820c7de8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6e1b62-bfb8-4b96-8de7-9ac75cb6cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:09:59 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Volume 1e19594a-0967-4705-a9e9-c919bd9e44d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e19594a-0967-4705-a9e9-c919bd9e44d2', 'volume_size': 1} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-462267134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e19594a-0967-4705-a9e9-c919bd9e44d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:59Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Creating volume 1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:09:59 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:59 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 1073741824 Nov 05 12:09:59 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:09:59 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 1073741824" returned: 0 in 0.523s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:09:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:09:59 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 Nov 05 12:09:59 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:00 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2" returned: 0 in 0.311s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:10:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6e1b62-bfb8-4b96-8de7-9ac75cb6cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e19594a-0967-4705-a9e9-c919bd9e44d2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81f7cb5-55bb-4daa-b9fb-0f07c152a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:00 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Volume volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 (1e19594a-0967-4705-a9e9-c919bd9e44d2): created successfully Nov 05 12:10:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81f7cb5-55bb-4daa-b9fb-0f07c152a109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (275605ab-9a54-4894-b5db-cfb20cb28d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:10:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d2c409ca-fa4a-437b-aac6-694eb49159df tempest-VolumesSnapshotTestJSON-806646738 None] Created volume successfully. Nov 05 12:10:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Creating offline snapshot 4fa68018-8174-437a-b0ea-271680cd68ff of volume 1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:10:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf90c02-0009-45e9-892f-3d3cd660430e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:01 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 Nov 05 12:10:01 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:01 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2" returned: 0 in 0.422s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:01 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff 1G Nov 05 12:10:01 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:02 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff 1G" returned: 0 in 0.603s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:02 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff Nov 05 12:10:02 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:02 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff" returned: 0 in 0.345s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:02 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff is being set with open permissions: ugo+rw Nov 05 12:10:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:02 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff Nov 05 12:10:02 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:03 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff" returned: 0 in 0.285s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:03 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.info Nov 05 12:10:03 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:03 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.info" returned: 0 in 0.268s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:03 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.info is being set with open permissions: ugo+rw Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:03 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.info Nov 05 12:10:03 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:03 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.info" returned: 0 in 0.383s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Flow 'volume_create_manager' (97812806-cf43-4f3f-9efb-b8b7791717dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92e9f3a-7b2c-4f36-890c-187057e70a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:03 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-596479df-27b9-4a88-b47c-adbf21a86996 tempest-VolumesSnapshotTestJSON-806646738 None] Create snapshot completed successfully Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92e9f3a-7b2c-4f36-890c-187057e70a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c757d20c-f345-477a-ae6c-34e097a356c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dc017bb95c480c9a320f94177558fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:04Z,use_quota=True,user_id='b8bdcd3f089e4c0e8dbb86bf30f8af23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018cb9eb-642e-43ed-ba7a-318e761cdac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018cb9eb-642e-43ed-ba7a-318e761cdac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c456ec2-735c-411f-bf77-1364d62ba29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:03 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c456ec2-735c-411f-bf77-1364d62ba29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c757d20c-f345-477a-ae6c-34e097a356c2', 'volume_name': 'volume-c757d20c-f345-477a-ae6c-34e097a356c2', 'volume_size': 1, 'image_id': 'ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '583e38996d1e4f94b3118176095b01a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13dc017bb95c480c9a320f94177558fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9290e75f4cbf7ec742062ad465ad93de9d70489aeeacbc82d43f33442d9645c1d6f1c1b9ba20d60b0b18dfa3155be9794479138bee4c1210eccd3719d2690f3', 'id': 'ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'created_at': datetime.datetime(2026, 11, 5, 11, 10, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 10, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628/file', 'properties': {}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ab59a3-09bc-49f7-987c-6c1aad4fe227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ab59a3-09bc-49f7-987c-6c1aad4fe227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b243a0a-ca8f-4cd4-9c4d-fc2d723314df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:04 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Volume c757d20c-f345-477a-ae6c-34e097a356c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c757d20c-f345-477a-ae6c-34e097a356c2', 'volume_size': 1, 'image_id': 'ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '583e38996d1e4f94b3118176095b01a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13dc017bb95c480c9a320f94177558fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9290e75f4cbf7ec742062ad465ad93de9d70489aeeacbc82d43f33442d9645c1d6f1c1b9ba20d60b0b18dfa3155be9794479138bee4c1210eccd3719d2690f3', 'id': 'ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'created_at': datetime.datetime(2026, 11, 5, 11, 10, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 10, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628/file', 'properties': {}}, 'image_service': } Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Trying to clone c757d20c-f345-477a-ae6c-34e097a356c2 from image ede52967-bc9b-4907-ac4e-ff2dc0d49628 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:10:04 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Image download 0.00 MB at 0.00 MB/s Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bc619e-faef-4cec-8027-46fd2edb54bc]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:04 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD Nov 05 12:10:04 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:04 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:04 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD Nov 05 12:10:04 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:10:05 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Temporary image ede52967-bc9b-4907-ac4e-ff2dc0d49628 is fetched for user b8bdcd3f089e4c0e8dbb86bf30f8af23. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (b07dfcfc-37c6-4581-a7c2-93bafd693a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea24445-e756-42a8-95f2-fa0fd862bd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea24445-e756-42a8-95f2-fa0fd862bd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-901719343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45898c7-0e8e-4426-ba2a-04e7307a48a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b5ab8fecac4a59bbbd88179fe10ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4fa68018-8174-437a-b0ea-271680cd68ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:05Z,use_quota=True,user_id='b3ec618146a84f1eb96caf060d7e3906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a45218-4251-4a06-9e4a-d629817423f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a45218-4251-4a06-9e4a-d629817423f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06579fda-6287-4fcc-a6c1-0695ded57eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06579fda-6287-4fcc-a6c1-0695ded57eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a45898c7-0e8e-4426-ba2a-04e7307a48a1', 'volume_name': 'volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1', 'volume_size': 1, 'snapshot_id': '4fa68018-8174-437a-b0ea-271680cd68ff'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c04f89-fdbd-4039-972d-b2339721443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c04f89-fdbd-4039-972d-b2339721443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346e0f6b-ba52-463a-94ae-a29700ae6d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Volume a45898c7-0e8e-4426-ba2a-04e7307a48a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1', 'volume_size': 1, 'snapshot_id': '4fa68018-8174-437a-b0ea-271680cd68ff'} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-4fa68018-8174-437a-b0ea-271680cd68ff-a45898c7-0e8e-4426-ba2a-04e7307a48a1" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[691bc8dc-110c-4d54-a018-8a8f6d4de3ba]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fa68018-8174-437a-b0ea-271680cd68ff-a45898c7-0e8e-4426-ba2a-04e7307a48a1" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Creating volume a45898c7-0e8e-4426-ba2a-04e7307a48a1 from snapshot 4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-a45898c7-0e8e-4426-ba2a-04e7307a48a1" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-a45898c7-0e8e-4426-ba2a-04e7307a48a1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] snapshot: 4fa68018-8174-437a-b0ea-271680cd68ff, volume: a45898c7-0e8e-4426-ba2a-04e7307a48a1, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9add47a-36d3-48bd-a0ef-df70ec9f983b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:05 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD Nov 05 12:10:05 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:05 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff Nov 05 12:10:05 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:05 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:05 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff" returned: 0 in 0.437s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e19594a-0967-4705-a9e9-c919bd9e44d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[db909c51-8ab6-44d9-86bc-6dc2f9f89664]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:05 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD Nov 05 12:10:05 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:05 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 Nov 05 12:10:05 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:06 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:06 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2" returned: 0 in 0.390s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:10:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:06 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 Nov 05 12:10:06 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-43b0b898-e0c8-487a-bdd7-50725defb054 req-8629bc3f-b8e4-4d91-b97a-2e9e50556052 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:13 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1" returned: 0 in 7.176s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:10:13 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Converted 1024.00 MB image at 142.68 MB/s Nov 05 12:10:13 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 is being set with open permissions: ugo+rw Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:13 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 Nov 05 12:10:13 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:13 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1" returned: 0 in 0.259s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-a45898c7-0e8e-4426-ba2a-04e7307a48a1" released by "_copy_volume_from_snapshot" :: held 8.366s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fa68018-8174-437a-b0ea-271680cd68ff-a45898c7-0e8e-4426-ba2a-04e7307a48a1" released by "_create_volume_from_snapshot" :: held 8.443s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.472s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.645s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c757d20c-f345-477a-ae6c-34e097a356c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dc017bb95c480c9a320f94177558fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:04Z,use_quota=True,user_id='b8bdcd3f089e4c0e8dbb86bf30f8af23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Creating volume c757d20c-f345-477a-ae6c-34e097a356c2 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:10:13 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:13 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 1073741824 Nov 05 12:10:13 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346e0f6b-ba52-463a-94ae-a29700ae6d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1', 'volume_size': 1, 'snapshot_id': '4fa68018-8174-437a-b0ea-271680cd68ff'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b960d700-c7ca-4818-8820-a8d8be9a0f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Volume volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 (a45898c7-0e8e-4426-ba2a-04e7307a48a1): created successfully Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b960d700-c7ca-4818-8820-a8d8be9a0f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Flow 'volume_create_manager' (b07dfcfc-37c6-4581-a7c2-93bafd693a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:10:13 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-18993cc0-3353-4dc5-bd18-e838314c2ac6 tempest-VolumesSnapshotTestJSON-806646738 None] Created volume successfully. Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-a45898c7-0e8e-4426-ba2a-04e7307a48a1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-a45898c7-0e8e-4426-ba2a-04e7307a48a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-a45898c7-0e8e-4426-ba2a-04e7307a48a1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-a45898c7-0e8e-4426-ba2a-04e7307a48a1" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac8e29-fdf3-4794-b7d2-8c6a89462edb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:14 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 1073741824" returned: 0 in 0.510s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:14 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 Nov 05 12:10:14 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:14 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 Nov 05 12:10:14 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:14 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2" returned: 0 in 0.309s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-43b0b898-e0c8-487a-bdd7-50725defb054 req-8629bc3f-b8e4-4d91-b97a-2e9e50556052 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.827s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-43b0b898-e0c8-487a-bdd7-50725defb054 req-8629bc3f-b8e4-4d91-b97a-2e9e50556052 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Attempting download of ede52967-bc9b-4907-ac4e-ff2dc0d49628 ((None, [{'url': 'file:///opt/stack/data/glance/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'metadata': {}}])) to volume c757d20c-f345-477a-ae6c-34e097a356c2. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-43b0b898-e0c8-487a-bdd7-50725defb054 req-8629bc3f-b8e4-4d91-b97a-2e9e50556052 tempest-TestServerVolumeAttachmentScenario-163891015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6193b7a0-517b-44c4-9f91-991c063421fa', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:10:14 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1" returned: 0 in 0.468s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:14 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1 Nov 05 12:10:14 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5a68c-b773-4456-a4bf-46ab7c6bae5d]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ede52967-bc9b-4907-ac4e-ff2dc0d49628_78orxdd_ {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-43b0b898-e0c8-487a-bdd7-50725defb054 req-8629bc3f-b8e4-4d91-b97a-2e9e50556052 tempest-TestServerVolumeAttachmentScenario-163891015 None] attachment_update completed successfully. Nov 05 12:10:14 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ede52967-bc9b-4907-ac4e-ff2dc0d49628_78orxdd_ Nov 05 12:10:14 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:15 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a45898c7-0e8e-4426-ba2a-04e7307a48a1" returned: 0 in 0.311s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-a45898c7-0e8e-4426-ba2a-04e7307a48a1" released by "delete_volume" :: held 0.830s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:15 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ede52967-bc9b-4907-ac4e-ff2dc0d49628_78orxdd_" returned: 0 in 0.371s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ede52967-bc9b-4907-ac4e-ff2dc0d49628_78orxdd_ {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['4c725088-dbcd-4f70-8c39-2577525c3f98', 'c942019f-6988-4605-9650-330c3024ce10', 'edb53d33-5d19-4e57-8e3e-fa66ee97475c', '20d6aaad-1758-474c-beee-5e7c5d7b08d9'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:15 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ede52967-bc9b-4907-ac4e-ff2dc0d49628_78orxdd_ Nov 05 12:10:15 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:15 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:15 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-4fa68018-8174-437a-b0ea-271680cd68ff-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-4fa68018-8174-437a-b0ea-271680cd68ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-1e19594a-0967-4705-a9e9-c919bd9e44d2" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-1e19594a-0967-4705-a9e9-c919bd9e44d2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-4fa68018-8174-437a-b0ea-271680cd68ff" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fa68018-8174-437a-b0ea-271680cd68ff" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Deleting offline snapshot 4fa68018-8174-437a-b0ea-271680cd68ff of volume 1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:10:15 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] snapshot_file for this snap is: volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.319s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9baf5c-554a-4587-b726-d0ec5ae31507]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Deleted volume successfully. Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:15 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ede52967-bc9b-4907-ac4e-ff2dc0d49628_78orxdd_" returned: 1 in 0.490s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ede52967-bc9b-4907-ac4e-ff2dc0d49628_78orxdd_' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[504dcb5f-fbb4-445b-ba0d-4b4955425ce8]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-15ab46f8-a6df-420a-ae5f-1fe68623de6d tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-a45898c7-0e8e-4426-ba2a-04e7307a48a1-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:15 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff Nov 05 12:10:15 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:15 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD Nov 05 12:10:15 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:16 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:16 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff" returned: 0 in 0.434s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e19594a-0967-4705-a9e9-c919bd9e44d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[321aa555-c763-45c6-bc65-23e43c08ece0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:16 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD Nov 05 12:10:16 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:16 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 Nov 05 12:10:16 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:16 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] ede52967-bc9b-4907-ac4e-ff2dc0d49628 was raw, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:16 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 Nov 05 12:10:16 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:16 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2" returned: 0 in 0.604s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:16 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff Nov 05 12:10:16 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:16 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2" returned: 0 in 0.587s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ede52967-bc9b-4907-ac4e-ff2dc0d49628_wf5a6rhbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:10:16 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 12:10:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:16 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 1G Nov 05 12:10:17 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:17 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff" returned: 0 in 0.432s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:17 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff Nov 05 12:10:17 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:17 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 1G" returned: 0 in 0.382s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Downloaded image ede52967-bc9b-4907-ac4e-ff2dc0d49628 ((None, [{'url': 'file:///opt/stack/data/glance/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'metadata': {}}])) to volume c757d20c-f345-477a-ae6c-34e097a356c2 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Temporary image ede52967-bc9b-4907-ac4e-ff2dc0d49628 for user b8bdcd3f089e4c0e8dbb86bf30f8af23 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Marking volume c757d20c-f345-477a-ae6c-34e097a356c2 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Copying metadata from image ede52967-bc9b-4907-ac4e-ff2dc0d49628 to c757d20c-f345-477a-ae6c-34e097a356c2. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Creating volume glance metadata for volume c757d20c-f345-477a-ae6c-34e097a356c2 backed by image ede52967-bc9b-4907-ac4e-ff2dc0d49628 with: {'image_id': 'ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '583e38996d1e4f94b3118176095b01a5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:10:17 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2.4fa68018-8174-437a-b0ea-271680cd68ff" returned: 0 in 0.317s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fa68018-8174-437a-b0ea-271680cd68ff" released by "_delete_snapshot" :: held 1.975s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b243a0a-ca8f-4cd4-9c4d-fc2d723314df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c757d20c-f345-477a-ae6c-34e097a356c2', 'volume_size': 1, 'image_id': 'ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '583e38996d1e4f94b3118176095b01a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13dc017bb95c480c9a320f94177558fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9290e75f4cbf7ec742062ad465ad93de9d70489aeeacbc82d43f33442d9645c1d6f1c1b9ba20d60b0b18dfa3155be9794479138bee4c1210eccd3719d2690f3', 'id': 'ede52967-bc9b-4907-ac4e-ff2dc0d49628', 'created_at': datetime.datetime(2026, 11, 5, 11, 10, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 10, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ede52967-bc9b-4907-ac4e-ff2dc0d49628/file', 'properties': {}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dfccfc-2415-41a1-9583-52e26c74fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-1e19594a-0967-4705-a9e9-c919bd9e44d2" released by "delete_snapshot" :: held 2.028s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:17 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Volume volume-c757d20c-f345-477a-ae6c-34e097a356c2 (c757d20c-f345-477a-ae6c-34e097a356c2): created successfully Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dfccfc-2415-41a1-9583-52e26c74fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Flow 'volume_create_manager' (97812806-cf43-4f3f-9efb-b8b7791717dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:10:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-505f506e-e0e0-487d-9449-cb1d61ddc94a tempest-VolumeImageDependencyTests-1982950724 None] Created volume successfully. Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['9c821593-294f-4ae7-a054-cb6b0abc8c31', 'c28bd89e-1d8b-4374-b866-b5e0d0bfba37', 'a0d3bf02-08ac-4f63-a519-4b4851fd5201', 'd8edb1e2-cc95-4dc4-915c-c208194b0610'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Delete snapshot completed successfully. Nov 05 12:10:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4516290e-f709-4d8e-aa0b-70dc6d448ed9 tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-4fa68018-8174-437a-b0ea-271680cd68ff-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Acquiring lock "cinder-c757d20c-f345-477a-ae6c-34e097a356c2-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Lock "cinder-c757d20c-f345-477a-ae6c-34e097a356c2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Acquiring lock "cinder-quobyte-c757d20c-f345-477a-ae6c-34e097a356c2" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Lock "cinder-quobyte-c757d20c-f345-477a-ae6c-34e097a356c2" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cabb66-7869-485b-b8df-fc36529abeed]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:18 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 Nov 05 12:10:18 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:18 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2" returned: 0 in 0.416s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:18 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2 Nov 05 12:10:18 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-1e19594a-0967-4705-a9e9-c919bd9e44d2-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-1e19594a-0967-4705-a9e9-c919bd9e44d2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-1e19594a-0967-4705-a9e9-c919bd9e44d2" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:18 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c757d20c-f345-477a-ae6c-34e097a356c2" returned: 0 in 0.290s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-1e19594a-0967-4705-a9e9-c919bd9e44d2" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Lock "cinder-quobyte-c757d20c-f345-477a-ae6c-34e097a356c2" released by "delete_volume" :: held 0.812s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61ab9a0-aed9-47ae-8938-cbb8d94cb2d3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Created reservations ['5cbf2dfd-c975-4aeb-86a1-e0b394584366', '867aafea-c3d8-4cae-ab69-924bc4521f8c', 'cd35e0e7-1b5f-45c5-a818-32da1cc5e089', 'e96fdffd-0489-4bbb-bc25-1c3a5b7c44f0'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:19 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 Nov 05 12:10:19 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:19 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:19 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:19 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.315s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:19 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Deleted volume successfully. Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2" returned: 0 in 0.495s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c7debb1f-688e-432e-ab45-8cc16de3d09a tempest-VolumeImageDependencyTests-1982950724 None] Lock "cinder-c757d20c-f345-477a-ae6c-34e097a356c2-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:19 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2 Nov 05 12:10:19 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-dbae31db-8c8e-4d7b-8017-fb360dfbfe26 req-04f8fdd2-d937-4b93-823a-986e2a5589b0 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-dbae31db-8c8e-4d7b-8017-fb360dfbfe26 req-04f8fdd2-d937-4b93-823a-986e2a5589b0 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-dbae31db-8c8e-4d7b-8017-fb360dfbfe26 req-04f8fdd2-d937-4b93-823a-986e2a5589b0 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:19 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1e19594a-0967-4705-a9e9-c919bd9e44d2" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-dbae31db-8c8e-4d7b-8017-fb360dfbfe26 req-04f8fdd2-d937-4b93-823a-986e2a5589b0 tempest-TestServerVolumeAttachmentScenario-163891015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aff6d978-d1b8-476a-811e-85f6e260dff8', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-1e19594a-0967-4705-a9e9-c919bd9e44d2" released by "delete_volume" :: held 0.863s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-dbae31db-8c8e-4d7b-8017-fb360dfbfe26 req-04f8fdd2-d937-4b93-823a-986e2a5589b0 tempest-TestServerVolumeAttachmentScenario-163891015 None] attachment_update completed successfully. Nov 05 12:10:19 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['463734c7-37f6-4cf1-a0fb-ea6b4463ef88', '0d458c0a-0629-4e1d-b706-70744d993c60', '7fa446c6-b1be-45c6-b1a8-ed30f42f897e', '4461b503-9b19-44cb-bc1a-5e93844c69af'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:20 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:20 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "cinder-quobyte-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" acquired by "delete_volume" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6f0789-38c2-44dc-98f5-6f80356b9960]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:20 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Deleted volume successfully. Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-836b3987-17ef-44e5-8ddd-fff7677b018b tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-1e19594a-0967-4705-a9e9-c919bd9e44d2-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:20 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d Nov 05 12:10:20 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:20 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" returned: 0 in 0.491s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:20 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d Nov 05 12:10:20 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:21 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" returned: 0 in 0.303s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-quobyte-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d" released by "delete_volume" :: held 0.922s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Created reservations ['53d71ab5-241a-47a2-8b93-20ce556e9fcd', '84f8ff49-a793-4104-84cb-f5d86ea1936b', '6bf2d112-8b6f-4d51-a104-1fdc196fc963', 'cd0aa5cf-02b8-40cd-828c-4dc286dbb70f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:21 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:21 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:21 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.279s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:21 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Deleted volume successfully. Nov 05 12:10:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-31c9a828-68f3-4ac4-90b4-9014f91b69cc tempest-VolumesSnapshotTestJSON-806646738 None] Lock "cinder-4fc7213a-b3f3-4179-8f9e-3a8da8583a0d-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-ad569d4c-0f83-4cce-8b5f-53b4f9781faa req-060a5f59-af38-47dc-b767-da62ad7d18d5 tempest-TestServerVolumeAttachmentScenario-163891015 None] Terminate volume connection completed successfully. Nov 05 12:10:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ad569d4c-0f83-4cce-8b5f-53b4f9781faa req-060a5f59-af38-47dc-b767-da62ad7d18d5 tempest-TestServerVolumeAttachmentScenario-163891015 None] Deleting attachment aff6d978-d1b8-476a-811e-85f6e260dff8. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:10:24 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=149,cinder:SELECT=144,cinder:INSERT=47,cinder:DELETE=14 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:10:24 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=154,cinder:SELECT=139,cinder:INSERT=46,cinder:DELETE=12 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:10:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-3971be2c-3d60-4aee-aa1a-20df17d200a6 req-1b793d5c-a3c1-4f34-86fb-148dc9f655a0 tempest-TestServerVolumeAttachmentScenario-163891015 None] Terminate volume connection completed successfully. Nov 05 12:10:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-3971be2c-3d60-4aee-aa1a-20df17d200a6 req-1b793d5c-a3c1-4f34-86fb-148dc9f655a0 tempest-TestServerVolumeAttachmentScenario-163891015 None] Deleting attachment 6193b7a0-517b-44c4-9f91-991c063421fa. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "cinder-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "cinder-quobyte-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-quobyte-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62f809-cce1-4d2e-8ef5-0ef1fe4bbd9a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:30 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 Nov 05 12:10:30 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:30 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36" returned: 0 in 0.440s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:30 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36 Nov 05 12:10:30 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:30 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36" returned: 0 in 0.280s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-quobyte-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36" released by "delete_volume" :: held 0.775s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Created reservations ['8807ee29-086c-4116-9750-570fe1bf1fc5', '8fe686e8-3ade-4311-88af-435988c654b7', '46095010-31bf-4033-a87d-4ba7b012eda3', '04e0861a-78ef-4dbe-b2ca-ba96387ff068'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:31 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:31 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "cinder-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "cinder-quobyte-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-quobyte-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ab3ca3-bf52-4df2-83f9-8f1d0150efd9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:31 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.319s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Deleted volume successfully. Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2f184a20-b181-4204-b5d1-165461e4da21 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-b6bcc3dc-b2c2-46e7-99c6-eaeb2cfaeb36-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:31 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 Nov 05 12:10:31 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:31 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2" returned: 0 in 0.424s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:31 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2 Nov 05 12:10:31 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:32 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2" returned: 0 in 0.264s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-quobyte-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2" released by "delete_volume" :: held 0.741s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Created reservations ['55281fc2-5b41-412d-85f5-516067f65c4d', '74e9482c-9800-4269-8210-f944c226c0d3', '99989470-1095-45ee-b42b-aaf598931662', '67750b8f-a200-4c3b-9795-1ee56c4d200d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:32 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:32 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:32 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.322s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Deleted volume successfully. Nov 05 12:10:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-50c9a039-ceb9-40e8-aeb8-750fe08d64a1 tempest-TestServerVolumeAttachmentScenario-163891015 None] Lock "cinder-4f1c1c39-bb89-45d8-b864-d1cd8b669ae2-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Flow 'volume_create_manager' (553f1f74-2901-4a8a-b60d-22fc2eefeeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b71809-e22a-4068-a90f-18179ec537c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b71809-e22a-4068-a90f-18179ec537c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2089406787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8d673a-b076-4a9c-8de8-b7ce0543a2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56e339f8d7947448e522d947844b6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:33Z,use_quota=True,user_id='9b39cf904cba4dfeb5bdac3c4c238a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97924c44-cde9-4d0a-baa1-8aa8d0a51dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97924c44-cde9-4d0a-baa1-8aa8d0a51dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d950e935-bb3c-447d-a4b2-5b6adc56b2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d950e935-bb3c-447d-a4b2-5b6adc56b2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8d673a-b076-4a9c-8de8-b7ce0543a2c8', 'volume_name': 'volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8', 'volume_size': 2}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320d0633-d82f-4e0d-8ad8-70e89eb54f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320d0633-d82f-4e0d-8ad8-70e89eb54f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054d25c5-37a4-4e39-973c-bd28afd7cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Volume 1a8d673a-b076-4a9c-8de8-b7ce0543a2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8', 'volume_size': 2} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2089406787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8d673a-b076-4a9c-8de8-b7ce0543a2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56e339f8d7947448e522d947844b6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:33Z,use_quota=True,user_id='9b39cf904cba4dfeb5bdac3c4c238a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Creating volume 1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:10:33 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 2147483648 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:33 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 2147483648 Nov 05 12:10:33 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:33 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 2147483648" returned: 0 in 0.604s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:33 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 Nov 05 12:10:33 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:34 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" returned: 0 in 0.283s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:10:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054d25c5-37a4-4e39-973c-bd28afd7cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8', 'volume_size': 2}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4e4dc6-974a-44e9-9006-b1dc95b31d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:10:34 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Volume volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 (1a8d673a-b076-4a9c-8de8-b7ce0543a2c8): created successfully Nov 05 12:10:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4e4dc6-974a-44e9-9006-b1dc95b31d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:10:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Flow 'volume_create_manager' (553f1f74-2901-4a8a-b60d-22fc2eefeeae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:10:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8bf598d1-bb37-4a9d-8ed7-e399583eed37 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Created volume successfully. Nov 05 12:10:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Creating offline snapshot 21b75de3-a7c3-41df-ab0c-ebd164849202 of volume 1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:10:35 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c6037d-c943-4c02-8530-9ae0602b2e96]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:35 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 Nov 05 12:10:35 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:35 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" returned: 0 in 0.382s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 2G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:35 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 2G Nov 05 12:10:35 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:36 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 2G" returned: 0 in 0.502s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:36 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 Nov 05 12:10:36 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:36 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202" returned: 0 in 0.433s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:36 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 is being set with open permissions: ugo+rw Nov 05 12:10:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:36 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 Nov 05 12:10:36 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:37 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202" returned: 0 in 0.275s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:37 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.info Nov 05 12:10:37 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:37 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.info" returned: 0 in 0.337s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:37 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.info is being set with open permissions: ugo+rw Nov 05 12:10:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:37 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.info Nov 05 12:10:37 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:37 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.info" returned: 0 in 0.280s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c558ca60-921a-484d-9646-edfea3b0f546 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Create snapshot completed successfully Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "cinder-21b75de3-a7c3-41df-ab0c-ebd164849202-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-21b75de3-a7c3-41df-ab0c-ebd164849202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "cinder-quobyte-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-quobyte-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "cinder-quobyte-21b75de3-a7c3-41df-ab0c-ebd164849202" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-quobyte-21b75de3-a7c3-41df-ab0c-ebd164849202" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Deleting offline snapshot 21b75de3-a7c3-41df-ab0c-ebd164849202 of volume 1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] snapshot_file for this snap is: volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbe456e-54bd-470b-b3b2-b931b924aaf8]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:39 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 Nov 05 12:10:39 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:39 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202" returned: 0 in 0.479s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:10:39 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2662c8-77ad-4405-ba7e-d2a075753f72]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:39 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 Nov 05 12:10:39 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:39 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" returned: 0 in 0.458s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:39 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 Nov 05 12:10:39 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:40 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202" returned: 0 in 0.393s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:40 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202 Nov 05 12:10:40 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:40 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8.21b75de3-a7c3-41df-ab0c-ebd164849202" returned: 0 in 0.322s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-quobyte-21b75de3-a7c3-41df-ab0c-ebd164849202" released by "_delete_snapshot" :: held 1.784s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-quobyte-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" released by "delete_snapshot" :: held 1.808s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:40 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Created reservations ['8f5b2a2c-4864-4004-ab33-4b9c44588239', '317dd20f-d953-403a-9f26-42fda4e1b4c9', 'c6082ddd-bd6b-46b2-b390-4db5b77695d2', '30300b80-dd24-4120-a648-d3575d15beb9'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:40 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Delete snapshot completed successfully. Nov 05 12:10:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecfdd540-7239-4265-9638-6a4349676e0d tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-21b75de3-a7c3-41df-ab0c-ebd164849202-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "cinder-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "cinder-quobyte-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-quobyte-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa275615-afb8-4657-b9e6-c53d5eb660f3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:41 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 Nov 05 12:10:41 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:41 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" returned: 0 in 0.478s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:41 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8 Nov 05 12:10:41 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:41 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" returned: 0 in 0.275s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-quobyte-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8" released by "delete_volume" :: held 0.835s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Created reservations ['0fcc4cf2-9baa-41f8-b7ae-08ca01f5aa5b', '6cc138af-ccca-4402-8861-34be962054df', 'fd39c961-f549-41e3-9a30-bd9472a16830', '1f870a67-6a98-4d7d-a75c-b71d08a0bdee'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:42 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:42 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:42 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Deleted volume successfully. Nov 05 12:10:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d42e0f78-4a76-4304-be15-028a693b2980 tempest-VolumesSnapshotNegativeTestJSON-394484158 None] Lock "cinder-1a8d673a-b076-4a9c-8de8-b7ce0543a2c8-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:10:52 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:10:52 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:10:52 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.447s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:10:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Flow 'volume_create_manager' (014db849-88ce-46ea-9d34-cc69ae6209cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c22402-fa31-4bda-a4c2-e5211d17daea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c22402-fa31-4bda-a4c2-e5211d17daea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1862525942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb73b46-3237-4499-8c68-15ea36aabd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6adc843f879428490c5a54120310cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:22Z,use_quota=True,user_id='91d681aff9b640c99fc5fb4b72db37a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d25c976-070d-4966-9d05-4d0bf45eece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d25c976-070d-4966-9d05-4d0bf45eece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711abb0-e2a0-40b3-b010-654a2c5551f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711abb0-e2a0-40b3-b010-654a2c5551f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adb73b46-3237-4499-8c68-15ea36aabd73', 'volume_name': 'volume-adb73b46-3237-4499-8c68-15ea36aabd73', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04cfe57-9e37-4c90-baa4-db1481aee2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04cfe57-9e37-4c90-baa4-db1481aee2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db1c4ea-0590-4599-9cb4-bab417f24688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:22 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Volume adb73b46-3237-4499-8c68-15ea36aabd73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adb73b46-3237-4499-8c68-15ea36aabd73', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 12:11:22 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Trying to clone adb73b46-3237-4499-8c68-15ea36aabd73 from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:11:23 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Image download 20.69 MB at 20.69 MB/s Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42bd418-c959-4150-9f3d-38275107e7be]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:23 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD Nov 05 12:11:23 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:11:23 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Flow 'volume_create_manager' (980a593b-5844-4b0f-8b8d-2eb9960a6b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ded7d1d-5025-471d-a092-8771faca7c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 is fetched for user 91d681aff9b640c99fc5fb4b72db37a1. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ded7d1d-5025-471d-a092-8771faca7c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-93072028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8bb5b7-1e04-45aa-be73-409cc932356a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9b3bed3d214fd9af582a0b28507862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:24Z,use_quota=True,user_id='6fbe2ae3118347ee99576464c9115453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9e31d2-97bf-4985-b032-2bdff3023dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9e31d2-97bf-4985-b032-2bdff3023dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074cccf1-d701-4f79-8b78-434c6df15d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074cccf1-d701-4f79-8b78-434c6df15d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8bb5b7-1e04-45aa-be73-409cc932356a', 'volume_name': 'volume-1a8bb5b7-1e04-45aa-be73-409cc932356a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d740864-638e-4930-86d2-9f4c14b6c5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d740864-638e-4930-86d2-9f4c14b6c5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316dfe4c-aba0-4633-a449-c64d950b64af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:23 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Volume 1a8bb5b7-1e04-45aa-be73-409cc932356a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8bb5b7-1e04-45aa-be73-409cc932356a', 'volume_size': 1} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-93072028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8bb5b7-1e04-45aa-be73-409cc932356a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9b3bed3d214fd9af582a0b28507862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:24Z,use_quota=True,user_id='6fbe2ae3118347ee99576464c9115453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Creating volume 1a8bb5b7-1e04-45aa-be73-409cc932356a {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:11:23 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:23 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a 1073741824 Nov 05 12:11:23 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3fd64-7022-4862-9508-4bb7ef0d6da0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:11:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:24 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD Nov 05 12:11:24 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:24 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:11:24 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a 1073741824" returned: 0 in 0.553s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:24 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a Nov 05 12:11:24 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:24 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a" returned: 0 in 0.282s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1862525942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb73b46-3237-4499-8c68-15ea36aabd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6adc843f879428490c5a54120310cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:22Z,use_quota=True,user_id='91d681aff9b640c99fc5fb4b72db37a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Creating volume adb73b46-3237-4499-8c68-15ea36aabd73 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:11:24 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316dfe4c-aba0-4633-a449-c64d950b64af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8bb5b7-1e04-45aa-be73-409cc932356a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:24 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 1073741824 Nov 05 12:11:24 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49d905f-41ee-4841-abee-9c6984656922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:24 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Volume volume-1a8bb5b7-1e04-45aa-be73-409cc932356a (1a8bb5b7-1e04-45aa-be73-409cc932356a): created successfully Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49d905f-41ee-4841-abee-9c6984656922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Flow 'volume_create_manager' (980a593b-5844-4b0f-8b8d-2eb9960a6b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:11:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-efe7a158-a6b7-4786-8457-e82daa9e6c8e tempest-TestMinimumBasicScenario-69083197 None] Created volume successfully. Nov 05 12:11:25 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 1073741824" returned: 0 in 0.509s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:25 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 Nov 05 12:11:25 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:25 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73" returned: 0 in 0.274s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Attempting download of 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume adb73b46-3237-4499-8c68-15ea36aabd73. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2f0548-4b93-44bd-8e09-6897782528d7]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:11:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_qkdk95oj {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:25 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_qkdk95oj Nov 05 12:11:25 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:26 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_qkdk95oj" returned: 0 in 0.372s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_qkdk95oj {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:26 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_qkdk95oj Nov 05 12:11:26 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:26 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_qkdk95oj" returned: 1 in 0.474s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035_qkdk95oj' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b0a5a9-fd3b-4576-ba73-75dd1033996f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:26 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD Nov 05 12:11:26 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b1d4245c-0116-4de1-8043-2a9a5495cf65 req-ebd9819e-54fa-438d-9a83-605815a9d667 tempest-TestMinimumBasicScenario-69083197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b1d4245c-0116-4de1-8043-2a9a5495cf65 req-ebd9819e-54fa-438d-9a83-605815a9d667 tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b1d4245c-0116-4de1-8043-2a9a5495cf65 req-ebd9819e-54fa-438d-9a83-605815a9d667 tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-b1d4245c-0116-4de1-8043-2a9a5495cf65 req-ebd9819e-54fa-438d-9a83-605815a9d667 tempest-TestMinimumBasicScenario-69083197 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-1a8bb5b7-1e04-45aa-be73-409cc932356a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6755f40f-a967-480b-8fff-7ecb9002b171', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:11:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-b1d4245c-0116-4de1-8043-2a9a5495cf65 req-ebd9819e-54fa-438d-9a83-605815a9d667 tempest-TestMinimumBasicScenario-69083197 None] attachment_update completed successfully. Nov 05 12:11:26 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 was qcow2, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:11:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:26 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 Nov 05 12:11:26 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:29 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73" returned: 0 in 2.310s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7eb1f079-bdd7-4e0e-80db-bea3d1fa7035__9e7dp7ndevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:11:29 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Converted 112.00 MB image at 48.45 MB/s Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:29 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 1G Nov 05 12:11:29 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:29 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 1G" returned: 0 in 0.418s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Downloaded image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 ((None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}])) to volume adb73b46-3237-4499-8c68-15ea36aabd73 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Temporary image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 for user 91d681aff9b640c99fc5fb4b72db37a1 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Marking volume adb73b46-3237-4499-8c68-15ea36aabd73 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Copying metadata from image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 to adb73b46-3237-4499-8c68-15ea36aabd73. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Creating volume glance metadata for volume adb73b46-3237-4499-8c68-15ea36aabd73 backed by image 7eb1f079-bdd7-4e0e-80db-bea3d1fa7035 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db1c4ea-0590-4599-9cb4-bab417f24688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb73b46-3237-4499-8c68-15ea36aabd73', 'volume_size': 1, 'image_id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '14e6c00a52184f3eb5c4cad2d5054b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7eb1f079-bdd7-4e0e-80db-bea3d1fa7035', 'created_at': datetime.datetime(2026, 11, 5, 10, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7eb1f079-bdd7-4e0e-80db-bea3d1fa7035/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aea6ff7-c943-4d84-9b8b-2410f9afeec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:11:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Volume volume-adb73b46-3237-4499-8c68-15ea36aabd73 (adb73b46-3237-4499-8c68-15ea36aabd73): created successfully Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aea6ff7-c943-4d84-9b8b-2410f9afeec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:11:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Flow 'volume_create_manager' (014db849-88ce-46ea-9d34-cc69ae6209cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:11:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-60e63c59-2fd0-49ed-a594-e9f7b4a96abb tempest-TestShelveInstance-170464915 None] Created volume successfully. Nov 05 12:11:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ed1a94e4-2047-4aa3-a987-9ae2c8309923 req-949b895b-e0cc-4752-9d6b-d99b0015f009 tempest-TestShelveInstance-170464915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:11:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ed1a94e4-2047-4aa3-a987-9ae2c8309923 req-949b895b-e0cc-4752-9d6b-d99b0015f009 tempest-TestShelveInstance-170464915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:11:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-ed1a94e4-2047-4aa3-a987-9ae2c8309923 req-949b895b-e0cc-4752-9d6b-d99b0015f009 tempest-TestShelveInstance-170464915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:11:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-ed1a94e4-2047-4aa3-a987-9ae2c8309923 req-949b895b-e0cc-4752-9d6b-d99b0015f009 tempest-TestShelveInstance-170464915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-adb73b46-3237-4499-8c68-15ea36aabd73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64883542-69ef-4884-9cc1-5a7ab8d1f690', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:11:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-ed1a94e4-2047-4aa3-a987-9ae2c8309923 req-949b895b-e0cc-4752-9d6b-d99b0015f009 tempest-TestShelveInstance-170464915 None] attachment_update completed successfully. Nov 05 12:11:44 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=9 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:11:44 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=12,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:11:52 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:11:52 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:11:52 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.281s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:11:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:12:02 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:12:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-4018fdba-3764-4e78-a858-7ed3739b871c req-f5478fca-f339-46a6-ac70-d934694a2a4a tempest-TestShelveInstance-170464915 None] Terminate volume connection completed successfully. Nov 05 12:12:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-4018fdba-3764-4e78-a858-7ed3739b871c req-f5478fca-f339-46a6-ac70-d934694a2a4a tempest-TestShelveInstance-170464915 None] Deleting attachment 64883542-69ef-4884-9cc1-5a7ab8d1f690. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:12:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-6d4f5a92-793d-4166-8f2b-aaf971e564fa req-91477115-1ed4-4c7e-a492-7b315a8515d8 tempest-TestShelveInstance-170464915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:12:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-6d4f5a92-793d-4166-8f2b-aaf971e564fa req-91477115-1ed4-4c7e-a492-7b315a8515d8 tempest-TestShelveInstance-170464915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:12:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-6d4f5a92-793d-4166-8f2b-aaf971e564fa req-91477115-1ed4-4c7e-a492-7b315a8515d8 tempest-TestShelveInstance-170464915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:12:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-6d4f5a92-793d-4166-8f2b-aaf971e564fa req-91477115-1ed4-4c7e-a492-7b315a8515d8 tempest-TestShelveInstance-170464915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-adb73b46-3237-4499-8c68-15ea36aabd73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '645aaea8-e537-4e58-a373-ee39284e89c5', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:12:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-6d4f5a92-793d-4166-8f2b-aaf971e564fa req-91477115-1ed4-4c7e-a492-7b315a8515d8 tempest-TestShelveInstance-170464915 None] attachment_update completed successfully. Nov 05 12:12:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-68641c6c-5188-4a17-a115-dacb3e35f373 req-02532e0a-145f-4507-9231-925b155d2cfa tempest-TestMinimumBasicScenario-69083197 None] Terminate volume connection completed successfully. Nov 05 12:12:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-68641c6c-5188-4a17-a115-dacb3e35f373 req-02532e0a-145f-4507-9231-925b155d2cfa tempest-TestMinimumBasicScenario-69083197 None] Deleting attachment 6755f40f-a967-480b-8fff-7ecb9002b171. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:12:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Acquiring lock "cinder-1a8bb5b7-1e04-45aa-be73-409cc932356a-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:12:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Lock "cinder-1a8bb5b7-1e04-45aa-be73-409cc932356a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:12:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Acquiring lock "cinder-quobyte-1a8bb5b7-1e04-45aa-be73-409cc932356a" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:12:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Lock "cinder-quobyte-1a8bb5b7-1e04-45aa-be73-409cc932356a" acquired by "delete_volume" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:12:17 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbdfee1-3dd5-4fc5-b67e-af86b285a5b3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:12:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:12:17 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a Nov 05 12:12:17 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:12:18 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a" returned: 0 in 0.465s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:12:18 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a Nov 05 12:12:18 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:12:18 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-1a8bb5b7-1e04-45aa-be73-409cc932356a" returned: 0 in 0.312s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Lock "cinder-quobyte-1a8bb5b7-1e04-45aa-be73-409cc932356a" released by "delete_volume" :: held 0.847s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Created reservations ['76cfdae0-8d9b-4832-bc46-9a7f740235dd', '17900c7b-4eab-480d-b02d-d3697ca9d047', '0162e2ae-5f95-412c-b4a5-3c44af62afcf', 'b65922df-9965-4513-9236-fdaf15faa878'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:12:18 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:12:18 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:12:18 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Nov 05 12:12:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.360s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:12:19 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:12:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Deleted volume successfully. Nov 05 12:12:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d4063416-7c67-42e6-985c-75c54000cc93 tempest-TestMinimumBasicScenario-69083197 None] Lock "cinder-1a8bb5b7-1e04-45aa-be73-409cc932356a-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:12:28 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:12:29 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:12:52 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:12:52 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:12:52 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.280s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:12:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:12:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-0c228735-602a-442a-a3f2-1fff8d654b76 tempest-TestShelveInstance-170464915 None] Terminate volume connection completed successfully. Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-0c228735-602a-442a-a3f2-1fff8d654b76 tempest-TestShelveInstance-170464915 None] Deleting attachment 645aaea8-e537-4e58-a373-ee39284e89c5. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Acquiring lock "cinder-adb73b46-3237-4499-8c68-15ea36aabd73-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Lock "cinder-adb73b46-3237-4499-8c68-15ea36aabd73-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Acquiring lock "cinder-quobyte-adb73b46-3237-4499-8c68-15ea36aabd73" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Lock "cinder-quobyte-adb73b46-3237-4499-8c68-15ea36aabd73" acquired by "delete_volume" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aebf9b8-ece3-477a-8e38-a11cfc0fcf19]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:12:57 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 Nov 05 12:12:57 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:12:57 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73" returned: 0 in 0.475s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:12:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:12:57 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73 Nov 05 12:12:57 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:12:58 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adb73b46-3237-4499-8c68-15ea36aabd73" returned: 0 in 0.286s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Lock "cinder-quobyte-adb73b46-3237-4499-8c68-15ea36aabd73" released by "delete_volume" :: held 0.829s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG cinder.quota [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Created reservations ['b472dd71-6306-420d-8230-257397df42d2', 'ecb75693-b64f-4fc5-894b-b0d6b4ab7174', 'e61d852b-b14e-46bc-91dd-1cd331fe8ace', '154960d3-f2f5-483e-9984-b9dbcb186349'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:12:58 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:12:58 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:12:58 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.287s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG cinder.manager [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:12:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Deleted volume successfully. Nov 05 12:12:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [req-000e1681-1567-4df4-bf45-79929cdf2a41 req-be49b43b-c369-4de9-9380-4f50ebb3e464 tempest-TestShelveInstance-170464915 None] Lock "cinder-adb73b46-3237-4499-8c68-15ea36aabd73-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:08 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=5 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:13:08 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Flow 'volume_create_manager' (8a25ffd6-76b8-447c-a565-81c536aca5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ebd7e1-d20c-4957-9f77-22edc5c794f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ebd7e1-d20c-4957-9f77-22edc5c794f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989a795a-dcb1-4dc5-b14b-10c05b28413a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7570449344524a66a75bcfc8fa04b898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:19Z,use_quota=True,user_id='07805a96629a4e4e9d01df514cd31557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb5467c6-129e-4cde-8e07-908bccab21e0),volume_type_id=eb5467c6-129e-4cde-8e07-908bccab21e0)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1176f1f0-3c2b-41fb-bc1d-b35e96748a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1176f1f0-3c2b-41fb-bc1d-b35e96748a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59382768-09b2-48e0-b869-b05618652519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59382768-09b2-48e0-b869-b05618652519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '989a795a-dcb1-4dc5-b14b-10c05b28413a', 'volume_name': 'volume-989a795a-dcb1-4dc5-b14b-10c05b28413a', 'volume_size': 1, 'image_id': '5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0616b988dbf8f2dcdc21cedf108dcbd4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7570449344524a66a75bcfc8fa04b898', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4270e39f9d067f93ebffe750f466404692881121ac96f66cddc0028c8b63ef2aa3e463736733c116dc9d350464458b209002bd18a51b80f1ddc3c5b017f8c44d', 'id': '5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0cd52c-f1a2-4239-ad72-aafc918d8b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0cd52c-f1a2-4239-ad72-aafc918d8b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b09a55-5397-49e5-a3aa-47bd901dcc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:19 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Volume 989a795a-dcb1-4dc5-b14b-10c05b28413a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-989a795a-dcb1-4dc5-b14b-10c05b28413a', 'volume_size': 1, 'image_id': '5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0616b988dbf8f2dcdc21cedf108dcbd4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7570449344524a66a75bcfc8fa04b898', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4270e39f9d067f93ebffe750f466404692881121ac96f66cddc0028c8b63ef2aa3e463736733c116dc9d350464458b209002bd18a51b80f1ddc3c5b017f8c44d', 'id': '5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Trying to clone 989a795a-dcb1-4dc5-b14b-10c05b28413a from image 5ec86fd8-73c7-4193-9f42-bc59e8b0798e at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:13:19 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Image download 0.00 MB at 0.00 MB/s Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7b71fc-e878-48c4-8d9d-34b1ba10d503]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:19 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD Nov 05 12:13:19 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:20 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:20 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD Nov 05 12:13:20 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:20 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Temporary image 5ec86fd8-73c7-4193-9f42-bc59e8b0798e is fetched for user 07805a96629a4e4e9d01df514cd31557. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[434fd068-c897-49c5-8a69-2064c5a7a060]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:20 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD Nov 05 12:13:20 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:20 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:21 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD Nov 05 12:13:21 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:21 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989a795a-dcb1-4dc5-b14b-10c05b28413a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7570449344524a66a75bcfc8fa04b898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:19Z,use_quota=True,user_id='07805a96629a4e4e9d01df514cd31557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb5467c6-129e-4cde-8e07-908bccab21e0),volume_type_id=eb5467c6-129e-4cde-8e07-908bccab21e0)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Creating volume 989a795a-dcb1-4dc5-b14b-10c05b28413a {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:21 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:21 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a 1073741824 Nov 05 12:13:21 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:21 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a 1073741824" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:21 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a Nov 05 12:13:21 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:22 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a" returned: 0 in 0.264s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Attempting download of 5ec86fd8-73c7-4193-9f42-bc59e8b0798e ((None, [{'url': 'file:///opt/stack/data/glance/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'metadata': {}}])) to volume 989a795a-dcb1-4dc5-b14b-10c05b28413a. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d449d93-0850-4dbe-a7a9-fbd7ae01e985]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_wsklz9we {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:22 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_wsklz9we Nov 05 12:13:22 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:22 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_wsklz9we" returned: 0 in 0.346s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_wsklz9we {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:22 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_wsklz9we Nov 05 12:13:22 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:22 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_wsklz9we" returned: 1 in 0.340s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_wsklz9we' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5936bd-492d-4c82-add4-b80cea1b37b5]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:22 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD Nov 05 12:13:22 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:23 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:23 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD Nov 05 12:13:23 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:23 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] 5ec86fd8-73c7-4193-9f42-bc59e8b0798e was raw, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:23 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a Nov 05 12:13:23 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:23 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a" returned: 0 in 0.477s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ec86fd8-73c7-4193-9f42-bc59e8b0798e_ro7qmp3ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:13:23 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 12:13:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:24 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a 1G Nov 05 12:13:24 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:24 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a 1G" returned: 0 in 0.324s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Downloaded image 5ec86fd8-73c7-4193-9f42-bc59e8b0798e ((None, [{'url': 'file:///opt/stack/data/glance/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'metadata': {}}])) to volume 989a795a-dcb1-4dc5-b14b-10c05b28413a successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Temporary image 5ec86fd8-73c7-4193-9f42-bc59e8b0798e for user 07805a96629a4e4e9d01df514cd31557 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Marking volume 989a795a-dcb1-4dc5-b14b-10c05b28413a as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Copying metadata from image 5ec86fd8-73c7-4193-9f42-bc59e8b0798e to 989a795a-dcb1-4dc5-b14b-10c05b28413a. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Creating volume glance metadata for volume 989a795a-dcb1-4dc5-b14b-10c05b28413a backed by image 5ec86fd8-73c7-4193-9f42-bc59e8b0798e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0616b988dbf8f2dcdc21cedf108dcbd4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b09a55-5397-49e5-a3aa-47bd901dcc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989a795a-dcb1-4dc5-b14b-10c05b28413a', 'volume_size': 1, 'image_id': '5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0616b988dbf8f2dcdc21cedf108dcbd4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7570449344524a66a75bcfc8fa04b898', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4270e39f9d067f93ebffe750f466404692881121ac96f66cddc0028c8b63ef2aa3e463736733c116dc9d350464458b209002bd18a51b80f1ddc3c5b017f8c44d', 'id': '5ec86fd8-73c7-4193-9f42-bc59e8b0798e', 'created_at': datetime.datetime(2026, 11, 5, 11, 13, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ec86fd8-73c7-4193-9f42-bc59e8b0798e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d410c6-987b-4e67-8057-9f9589ef29cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:24 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Volume volume-989a795a-dcb1-4dc5-b14b-10c05b28413a (989a795a-dcb1-4dc5-b14b-10c05b28413a): created successfully Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d410c6-987b-4e67-8057-9f9589ef29cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Flow 'volume_create_manager' (8a25ffd6-76b8-447c-a565-81c536aca5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-be6bfd54-bed6-46aa-817a-e46994aba606 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Created volume successfully. Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Acquiring lock "cinder-989a795a-dcb1-4dc5-b14b-10c05b28413a-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "cinder-989a795a-dcb1-4dc5-b14b-10c05b28413a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Acquiring lock "cinder-quobyte-989a795a-dcb1-4dc5-b14b-10c05b28413a" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "cinder-quobyte-989a795a-dcb1-4dc5-b14b-10c05b28413a" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[37918db5-7d41-4517-8124-16752095a377]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:24 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a Nov 05 12:13:24 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:25 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:25 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a Nov 05 12:13:25 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:25 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-989a795a-dcb1-4dc5-b14b-10c05b28413a" returned: 0 in 0.277s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "cinder-quobyte-989a795a-dcb1-4dc5-b14b-10c05b28413a" released by "delete_volume" :: held 0.717s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:25 devstack cinder-volume[86942]: WARNING cinder.quota [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:13:25 devstack cinder-volume[86942]: WARNING cinder.quota [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Created reservations ['d93e8c18-1fc4-471c-9cf1-670936aeaa0f', '5b32127c-aef0-4ad2-99b0-27772a5c56f2', '8c9af8ca-7c92-4d8f-bb5c-b4d679d27c1a', 'bdfe9e1a-857a-49f5-af12-a5755c957f4f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:25 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:25 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:25 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.297s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:25 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Deleted volume successfully. Nov 05 12:13:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a4474041-6004-4504-a39e-4d1849f42fd6 tempest-VolumeAndVolumeTypeFromImageTest-64933806 None] Lock "cinder-989a795a-dcb1-4dc5-b14b-10c05b28413a-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Flow 'volume_create_manager' (bc4e0ad1-105e-45b6-b4f2-bcffb90f1b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae461a9-5f46-4856-b34b-4cf90615c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae461a9-5f46-4856-b34b-4cf90615c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1937269343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232ee8eb-2594-451e-903f-e8a04b81c31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee9c658b0774b7185d782a4b4dc2d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:30Z,use_quota=True,user_id='f69d692fd7264da29718644990c54eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd22544e-33b6-4bd3-947f-ca69fc6041e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd22544e-33b6-4bd3-947f-ca69fc6041e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea83a7d-bc99-4440-9b45-4fb388259479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea83a7d-bc99-4440-9b45-4fb388259479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232ee8eb-2594-451e-903f-e8a04b81c31e', 'volume_name': 'volume-232ee8eb-2594-451e-903f-e8a04b81c31e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931965f4-6f17-4b67-a671-2aa2903287da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931965f4-6f17-4b67-a671-2aa2903287da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78578b52-c767-4cd9-bf25-8313a136aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Volume 232ee8eb-2594-451e-903f-e8a04b81c31e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232ee8eb-2594-451e-903f-e8a04b81c31e', 'volume_size': 1} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1937269343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232ee8eb-2594-451e-903f-e8a04b81c31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee9c658b0774b7185d782a4b4dc2d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:30Z,use_quota=True,user_id='f69d692fd7264da29718644990c54eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Creating volume 232ee8eb-2594-451e-903f-e8a04b81c31e {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:30 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:30 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e 1073741824 Nov 05 12:13:30 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (b458e5a3-6ad0-49b0-9720-c080cfc69643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1965f8ba-d6f9-47fe-93d4-161202661d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1965f8ba-d6f9-47fe-93d4-161202661d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-348498163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5313014c-2482-45ae-b85f-8e3d1887d2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:31Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55766745-55a9-4af5-b004-b589a9ba4f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55766745-55a9-4af5-b004-b589a9ba4f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0821d1-70c4-40d3-8f61-1a66e857505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0821d1-70c4-40d3-8f61-1a66e857505d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5313014c-2482-45ae-b85f-8e3d1887d2a2', 'volume_name': 'volume-5313014c-2482-45ae-b85f-8e3d1887d2a2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91872f03-4ad9-493b-9c3d-b6ca042d9c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91872f03-4ad9-493b-9c3d-b6ca042d9c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32958675-813c-4e45-8f4b-41b4ba666c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume 5313014c-2482-45ae-b85f-8e3d1887d2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5313014c-2482-45ae-b85f-8e3d1887d2a2', 'volume_size': 1} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:30 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e 1073741824" returned: 0 in 0.481s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:30 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e Nov 05 12:13:30 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:31 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e" returned: 0 in 0.257s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-348498163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5313014c-2482-45ae-b85f-8e3d1887d2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:31Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Creating volume 5313014c-2482-45ae-b85f-8e3d1887d2a2 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:31 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78578b52-c767-4cd9-bf25-8313a136aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232ee8eb-2594-451e-903f-e8a04b81c31e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc300f9-041e-4346-80ca-86c859c80b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:31 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 1073741824 Nov 05 12:13:31 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Volume volume-232ee8eb-2594-451e-903f-e8a04b81c31e (232ee8eb-2594-451e-903f-e8a04b81c31e): created successfully Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc300f9-041e-4346-80ca-86c859c80b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Flow 'volume_create_manager' (bc4e0ad1-105e-45b6-b4f2-bcffb90f1b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e8e046a0-d983-45b8-8978-c705442189a9 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Created volume successfully. Nov 05 12:13:31 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 1073741824" returned: 0 in 0.440s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:31 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 Nov 05 12:13:31 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:31 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32958675-813c-4e45-8f4b-41b4ba666c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5313014c-2482-45ae-b85f-8e3d1887d2a2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfce0e3-a6c7-4c27-9ce4-e43d09f8dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 (5313014c-2482-45ae-b85f-8e3d1887d2a2): created successfully Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfce0e3-a6c7-4c27-9ce4-e43d09f8dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (b458e5a3-6ad0-49b0-9720-c080cfc69643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6e86804d-ab29-4445-9468-ea423bff4c5e tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created volume successfully. Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-5f8c13d0-9e5e-405b-95d1-bdddd5ea8754 req-91519517-2247-438f-827b-bfa90ecab279 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-5f8c13d0-9e5e-405b-95d1-bdddd5ea8754 req-91519517-2247-438f-827b-bfa90ecab279 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-5f8c13d0-9e5e-405b-95d1-bdddd5ea8754 req-91519517-2247-438f-827b-bfa90ecab279 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-5f8c13d0-9e5e-405b-95d1-bdddd5ea8754 req-91519517-2247-438f-827b-bfa90ecab279 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-232ee8eb-2594-451e-903f-e8a04b81c31e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88f99a15-bc01-46f5-9612-378c45a1485f', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (e08c8549-6176-4beb-99fe-cc5abaaba609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c828e4-28e4-44c2-b43d-e7ee836cf027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c828e4-28e4-44c2-b43d-e7ee836cf027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847504824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ba0d93-5084-46bb-8a99-113199ec43cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:33Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a23056e-3415-4d1e-9bd6-fdd47ff1c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a23056e-3415-4d1e-9bd6-fdd47ff1c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037eab9b-24f5-4b56-99d5-02a6744e5afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037eab9b-24f5-4b56-99d5-02a6744e5afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ba0d93-5084-46bb-8a99-113199ec43cd', 'volume_name': 'volume-89ba0d93-5084-46bb-8a99-113199ec43cd', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccf674d-54d4-46a5-9380-e55981a45767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccf674d-54d4-46a5-9380-e55981a45767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a58e262-e98a-4bc8-b903-4b2ffc3e78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume 89ba0d93-5084-46bb-8a99-113199ec43cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ba0d93-5084-46bb-8a99-113199ec43cd', 'volume_size': 1} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847504824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ba0d93-5084-46bb-8a99-113199ec43cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:33Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Creating volume 89ba0d93-5084-46bb-8a99-113199ec43cd {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:33 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:33 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd 1073741824 Nov 05 12:13:33 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-5f8c13d0-9e5e-405b-95d1-bdddd5ea8754 req-91519517-2247-438f-827b-bfa90ecab279 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] attachment_update completed successfully. Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (a362b570-6ddb-4daa-a07d-c10673a27c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9732faf1-2b31-487f-8360-273a3de8b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9732faf1-2b31-487f-8360-273a3de8b69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434072767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5067cb-a000-4535-b668-1ac8a7d47a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:34Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58322d2c-9a45-41f9-a39a-20a1861be207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58322d2c-9a45-41f9-a39a-20a1861be207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace273a5-97e1-4ef3-b35e-ac0c645b544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace273a5-97e1-4ef3-b35e-ac0c645b544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5067cb-a000-4535-b668-1ac8a7d47a03', 'volume_name': 'volume-7a5067cb-a000-4535-b668-1ac8a7d47a03', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27c9a72-d670-4669-876b-d111bd86ce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27c9a72-d670-4669-876b-d111bd86ce52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e89465-bab5-4324-8fa9-7906c99986e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:33 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume 7a5067cb-a000-4535-b668-1ac8a7d47a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5067cb-a000-4535-b668-1ac8a7d47a03', 'volume_size': 1} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:33 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd 1073741824" returned: 0 in 0.597s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:33 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd Nov 05 12:13:33 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (c2cf7740-4a54-4fa4-b02a-4e2da8787f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04e11aa-be00-4413-bee4-2daf0b194830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04e11aa-be00-4413-bee4-2daf0b194830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113242630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aac47c-95f3-43fc-8671-53fa7a59a7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:34Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a627a2-26bf-46fc-907f-4bcffa190ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a627a2-26bf-46fc-907f-4bcffa190ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9480aaa3-71f3-49fa-b8d0-2e034f9d57e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9480aaa3-71f3-49fa-b8d0-2e034f9d57e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7aac47c-95f3-43fc-8671-53fa7a59a7e7', 'volume_name': 'volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3d740f-407b-41f8-b5c2-66b471cfe0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3d740f-407b-41f8-b5c2-66b471cfe0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e380a9c-b5f5-4ad0-8c39-3d6f681abd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume c7aac47c-95f3-43fc-8671-53fa7a59a7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7', 'volume_size': 1} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd" returned: 0 in 0.387s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434072767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5067cb-a000-4535-b668-1ac8a7d47a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:34Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Creating volume 7a5067cb-a000-4535-b668-1ac8a7d47a03 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:34 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a58e262-e98a-4bc8-b903-4b2ffc3e78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ba0d93-5084-46bb-8a99-113199ec43cd', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4d1f8a-9322-4435-975b-c4a8686d0ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 1073741824 Nov 05 12:13:34 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:34 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume volume-89ba0d93-5084-46bb-8a99-113199ec43cd (89ba0d93-5084-46bb-8a99-113199ec43cd): created successfully Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4d1f8a-9322-4435-975b-c4a8686d0ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (e08c8549-6176-4beb-99fe-cc5abaaba609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-43b51392-77e7-47f9-91ad-8fe8fc480114 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created volume successfully. Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (60b42ffe-b4b0-4a2f-a31d-169ea5698fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc20dcb-92da-4e24-af5d-675f74a4de6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc20dcb-92da-4e24-af5d-675f74a4de6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520544835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490a8c8-388c-4148-9e75-cca5b6cf205c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:35Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db670713-10d6-414e-929b-75dbc70c7016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db670713-10d6-414e-929b-75dbc70c7016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffb42c8-1b52-4b2d-a65d-11d61e5e37b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffb42c8-1b52-4b2d-a65d-11d61e5e37b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e490a8c8-388c-4148-9e75-cca5b6cf205c', 'volume_name': 'volume-e490a8c8-388c-4148-9e75-cca5b6cf205c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8a59e7-ff44-43d5-bc62-73f59d51439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8a59e7-ff44-43d5-bc62-73f59d51439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c04bf4-030c-43b5-8c4f-9179cd896f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:34 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume e490a8c8-388c-4148-9e75-cca5b6cf205c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e490a8c8-388c-4148-9e75-cca5b6cf205c', 'volume_size': 1} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:34 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 1073741824" returned: 0 in 0.581s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:35 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 Nov 05 12:13:35 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (1ba48dd4-1a81-46ba-8942-dd1aa7691196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03896244-3f5e-4c7d-834f-6e9bf44e63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03896244-3f5e-4c7d-834f-6e9bf44e63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121368688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1a4008-1f74-4ae5-9918-0e2e54f6cda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:35Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6347f2-abb7-4a39-8ec9-258d2f2458e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6347f2-abb7-4a39-8ec9-258d2f2458e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a9ee0b-411b-4168-90c9-16e03efc3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a9ee0b-411b-4168-90c9-16e03efc3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1a4008-1f74-4ae5-9918-0e2e54f6cda1', 'volume_name': 'volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e047e-efd4-47ad-a8c1-8190c01ec1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e047e-efd4-47ad-a8c1-8190c01ec1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee26591f-7f21-4725-9810-05f1657a579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:35 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume 6a1a4008-1f74-4ae5-9918-0e2e54f6cda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1', 'volume_size': 1} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:35 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03" returned: 0 in 0.299s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113242630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aac47c-95f3-43fc-8671-53fa7a59a7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:34Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Creating volume c7aac47c-95f3-43fc-8671-53fa7a59a7e7 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:35 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e89465-bab5-4324-8fa9-7906c99986e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5067cb-a000-4535-b668-1ac8a7d47a03', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6706a403-bff1-4b92-98ae-206d0c09e79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:35 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 1073741824 Nov 05 12:13:35 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:35 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 (7a5067cb-a000-4535-b668-1ac8a7d47a03): created successfully Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6706a403-bff1-4b92-98ae-206d0c09e79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (a362b570-6ddb-4daa-a07d-c10673a27c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:35 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d81846df-f86d-4dd0-98f3-b0e68fc40d01 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created volume successfully. Nov 05 12:13:35 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 1073741824" returned: 0 in 0.477s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:35 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 Nov 05 12:13:35 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:36 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520544835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490a8c8-388c-4148-9e75-cca5b6cf205c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:35Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Creating volume e490a8c8-388c-4148-9e75-cca5b6cf205c {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:36 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e380a9c-b5f5-4ad0-8c39-3d6f681abd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e407e7a3-b43e-42c3-98b9-5ca2e22ed39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:36 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c 1073741824 Nov 05 12:13:36 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:36 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 (c7aac47c-95f3-43fc-8671-53fa7a59a7e7): created successfully Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e407e7a3-b43e-42c3-98b9-5ca2e22ed39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (c2cf7740-4a54-4fa4-b02a-4e2da8787f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f3d0055d-6ad5-42c4-93c5-346ea6618687 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created volume successfully. Nov 05 12:13:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-1874c974-8a46-4d2f-8374-aa9c07cb3b8f req-9258983d-b1f9-4e74-bde2-ff02f6a12576 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Terminate volume connection completed successfully. Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-1874c974-8a46-4d2f-8374-aa9c07cb3b8f req-9258983d-b1f9-4e74-bde2-ff02f6a12576 tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Deleting attachment 88f99a15-bc01-46f5-9612-378c45a1485f. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:13:36 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c 1073741824" returned: 0 in 0.484s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:36 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c Nov 05 12:13:36 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:36 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c" returned: 0 in 0.263s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121368688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1a4008-1f74-4ae5-9918-0e2e54f6cda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754001b554f941ea80a089e84f3cb86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:35Z,use_quota=True,user_id='1dca3e6096e44c94b37b596c7f564264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Creating volume 6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:36 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c04bf4-030c-43b5-8c4f-9179cd896f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e490a8c8-388c-4148-9e75-cca5b6cf205c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:36 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 1073741824 Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d016c517-ebb1-40e6-a873-f32d72d6f424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:36 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:36 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume volume-e490a8c8-388c-4148-9e75-cca5b6cf205c (e490a8c8-388c-4148-9e75-cca5b6cf205c): created successfully Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d016c517-ebb1-40e6-a873-f32d72d6f424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:36 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (60b42ffe-b4b0-4a2f-a31d-169ea5698fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f99c4748-92fc-4d5c-ad04-26d5044f5cc2 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created volume successfully. Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Acquiring lock "cinder-232ee8eb-2594-451e-903f-e8a04b81c31e-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "cinder-232ee8eb-2594-451e-903f-e8a04b81c31e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Acquiring lock "cinder-quobyte-232ee8eb-2594-451e-903f-e8a04b81c31e" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "cinder-quobyte-232ee8eb-2594-451e-903f-e8a04b81c31e" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9030aa-94bf-4eb6-bbb6-fa95eb45a9a3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:37 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e Nov 05 12:13:37 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:37 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 1073741824" returned: 0 in 0.562s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:37 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 Nov 05 12:13:37 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:37 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e" returned: 0 in 0.402s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:37 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e Nov 05 12:13:37 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:37 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1" returned: 0 in 0.288s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee26591f-7f21-4725-9810-05f1657a579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a709d5e-d19e-4fcb-97aa-18e4c21d1e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:37 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Volume volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 (6a1a4008-1f74-4ae5-9918-0e2e54f6cda1): created successfully Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a709d5e-d19e-4fcb-97aa-18e4c21d1e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Flow 'volume_create_manager' (1ba48dd4-1a81-46ba-8942-dd1aa7691196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-893ee582-6c99-47fe-bd3f-e12d59319042 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created volume successfully. Nov 05 12:13:38 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-232ee8eb-2594-451e-903f-e8a04b81c31e" returned: 0 in 0.270s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "cinder-quobyte-232ee8eb-2594-451e-903f-e8a04b81c31e" released by "delete_volume" :: held 0.733s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Created reservations ['5d645da6-f40c-43b3-88e2-53445e1df8ae', '688cad53-7786-4034-ba42-ed0d2e76702f', '8bed252a-2f6d-40a4-bda4-d8b8cc9f090a', 'ce23d112-3076-4842-a0ca-d962dbfcae76'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:38 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:38 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:38 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.290s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Deleted volume successfully. Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ac42820-6f88-44b0-870f-696c97cf6b3d tempest-TestServerVolumeAttachScenarioOldVersion-1470287067 None] Lock "cinder-232ee8eb-2594-451e-903f-e8a04b81c31e-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-quobyte-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1" acquired by "delete_volume" :: waited 0.046s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6a3730-3650-4c9c-ab3b-e13f5a8c3098]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:38 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 Nov 05 12:13:38 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:39 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1" returned: 0 in 0.508s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:39 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1 Nov 05 12:13:39 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:39 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1" returned: 0 in 0.304s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1" released by "delete_volume" :: held 0.875s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created reservations ['8db8b295-ddc2-4812-ba89-8a8e3f8c12dc', '216817e4-22f0-4976-9df9-9d49f6e67b6e', 'dd74619b-a28c-41a9-84e4-c5ca435c3a28', '11d59027-e1ed-4dcb-b9cc-12b512005955'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:39 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:39 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-e490a8c8-388c-4148-9e75-cca5b6cf205c-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-e490a8c8-388c-4148-9e75-cca5b6cf205c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-quobyte-e490a8c8-388c-4148-9e75-cca5b6cf205c" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-e490a8c8-388c-4148-9e75-cca5b6cf205c" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[15653c52-41e6-4af1-881f-4de5b9c8fbc1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:40 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:40 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.345s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:40 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:40 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Deleted volume successfully. Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-594db2e5-3813-4888-92d4-b9e028d9280b tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-6a1a4008-1f74-4ae5-9918-0e2e54f6cda1-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:40 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c" returned: 0 in 0.509s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:40 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c Nov 05 12:13:40 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:40 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e490a8c8-388c-4148-9e75-cca5b6cf205c" returned: 0 in 0.273s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-e490a8c8-388c-4148-9e75-cca5b6cf205c" released by "delete_volume" :: held 0.841s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created reservations ['34d54b83-8939-4732-9c9b-504f3ad11df1', '3a783fe0-ad8c-455a-b20e-6934880f9eef', 'e3356f7d-6a35-4920-b7b8-5d2fde79b21c', '054a5a36-e002-4985-b47a-1c31e83a5ae7'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:40 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:40 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-c7aac47c-95f3-43fc-8671-53fa7a59a7e7-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-c7aac47c-95f3-43fc-8671-53fa7a59a7e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-quobyte-c7aac47c-95f3-43fc-8671-53fa7a59a7e7" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-c7aac47c-95f3-43fc-8671-53fa7a59a7e7" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ebbf27-511b-41b1-bb8e-9843120df750]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:41 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.286s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Deleted volume successfully. Nov 05 12:13:41 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a41a0d-2093-4abf-a35c-497b41fd7c41 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-e490a8c8-388c-4148-9e75-cca5b6cf205c-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:41 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:41 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:41 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7 Nov 05 12:13:41 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:41 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c7aac47c-95f3-43fc-8671-53fa7a59a7e7" returned: 0 in 0.287s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-c7aac47c-95f3-43fc-8671-53fa7a59a7e7" released by "delete_volume" :: held 0.743s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created reservations ['aa4610ba-6054-4e36-ac84-a46d02aacffa', '05b1038d-7ea6-4862-b03c-acd23e5ee81e', '16c4f154-38ea-4d71-b0f6-f2784d3d9ae0', '324c100a-f56f-475b-a4c7-15108a053f8a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:41 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:41 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-7a5067cb-a000-4535-b668-1ac8a7d47a03-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-7a5067cb-a000-4535-b668-1ac8a7d47a03-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:42 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.312s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Deleted volume successfully. Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-quobyte-7a5067cb-a000-4535-b668-1ac8a7d47a03" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ecd02534-e61e-4f41-9ba5-6bca9788fa78 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-c7aac47c-95f3-43fc-8671-53fa7a59a7e7-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-7a5067cb-a000-4535-b668-1ac8a7d47a03" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b43624f-0dab-4157-a26f-e686a59dc7d9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:42 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 Nov 05 12:13:42 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:42 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03" returned: 0 in 0.459s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:42 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03 Nov 05 12:13:42 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:43 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7a5067cb-a000-4535-b668-1ac8a7d47a03" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-7a5067cb-a000-4535-b668-1ac8a7d47a03" released by "delete_volume" :: held 0.809s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created reservations ['eed9ab8c-a036-44ee-bc3f-01e3907e5091', '4983fa0d-f065-4257-86e2-27c00f71f5d3', '0e7fe5f7-ddef-4bb5-a849-0edf297e01d2', 'f8d031d1-f63b-484d-abb4-073685f4a457'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:43 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:43 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-89ba0d93-5084-46bb-8a99-113199ec43cd-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-89ba0d93-5084-46bb-8a99-113199ec43cd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-quobyte-89ba0d93-5084-46bb-8a99-113199ec43cd" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-89ba0d93-5084-46bb-8a99-113199ec43cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[33780cb8-716c-4ec2-80b4-8f165837e16a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:43 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.310s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Deleted volume successfully. Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4089a75c-274f-434a-a5d8-1050f6918884 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-7a5067cb-a000-4535-b668-1ac8a7d47a03-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:43 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd Nov 05 12:13:43 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:43 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd" returned: 0 in 0.429s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:43 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd Nov 05 12:13:43 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:44 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-89ba0d93-5084-46bb-8a99-113199ec43cd" returned: 0 in 0.273s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-89ba0d93-5084-46bb-8a99-113199ec43cd" released by "delete_volume" :: held 0.753s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created reservations ['1a440237-33c0-4635-83d1-f36cc5334ea6', '712e757b-0081-4abf-9b89-1dd196072617', '667c423f-9239-44ae-a0b9-b5a6fa4b896a', '271051a8-6555-4ef6-acaa-c420eb773fee'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:44 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:44 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-5313014c-2482-45ae-b85f-8e3d1887d2a2-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-5313014c-2482-45ae-b85f-8e3d1887d2a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "cinder-quobyte-5313014c-2482-45ae-b85f-8e3d1887d2a2" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:44 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.312s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-5313014c-2482-45ae-b85f-8e3d1887d2a2" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:44 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Deleted volume successfully. Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f888500-41d8-4d1a-a4d2-ff7c8b85fadb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dcdd5485-6a62-4e32-b567-631c1b30a564 tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-89ba0d93-5084-46bb-8a99-113199ec43cd-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:44 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 Nov 05 12:13:44 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:45 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:45 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2 Nov 05 12:13:45 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:45 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5313014c-2482-45ae-b85f-8e3d1887d2a2" returned: 0 in 0.257s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-quobyte-5313014c-2482-45ae-b85f-8e3d1887d2a2" released by "delete_volume" :: held 0.711s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Created reservations ['8fcac9a1-6124-4a74-ad25-621661dda918', 'f767337f-7032-4f66-992e-6e4a835cacd7', '892689a3-3b3d-4d83-868f-9ea82caa812c', 'e490f14c-2398-49a2-a928-ccbedd795528'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:45 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:45 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:45 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.293s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Deleted volume successfully. Nov 05 12:13:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea527bdc-6cdc-4c57-a8b0-be7e5ab9092a tempest-CreateVolumesFromSourceVolumeTest-65945162 None] Lock "cinder-5313014c-2482-45ae-b85f-8e3d1887d2a2-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:52 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:52 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:52 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.344s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:13:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (e2b9ed4e-167c-4b9f-a6ff-871454a22756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba1d3d2-683c-4c14-9702-8477586572a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba1d3d2-683c-4c14-9702-8477586572a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372922120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e20b64a-2d53-4c4f-b0cf-6495adf41a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bfb498-6bcc-4011-b852-f007bc387903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bfb498-6bcc-4011-b852-f007bc387903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c683728-6d77-4489-a8ce-7c0e60c4aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c683728-6d77-4489-a8ce-7c0e60c4aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e20b64a-2d53-4c4f-b0cf-6495adf41a70', 'volume_name': 'volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c03126-b548-4adb-9d57-6962be4f7e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c03126-b548-4adb-9d57-6962be4f7e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26864ba-9dda-4b3d-b139-858842d4ad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:54 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Volume 5e20b64a-2d53-4c4f-b0cf-6495adf41a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70', 'volume_size': 1} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372922120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e20b64a-2d53-4c4f-b0cf-6495adf41a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Creating volume 5e20b64a-2d53-4c4f-b0cf-6495adf41a70 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:54 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:54 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 1073741824 Nov 05 12:13:54 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:55 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 1073741824" returned: 0 in 0.503s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:55 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 Nov 05 12:13:55 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:55 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70" returned: 0 in 0.271s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26864ba-9dda-4b3d-b139-858842d4ad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc9799a-f206-4894-94f7-05f297bce0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:55 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Volume volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 (5e20b64a-2d53-4c4f-b0cf-6495adf41a70): created successfully Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc9799a-f206-4894-94f7-05f297bce0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (e2b9ed4e-167c-4b9f-a6ff-871454a22756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-23d9ca2f-dfe2-4302-b26b-08c094deb23b tempest-ProjectReaderTests-48738943 None] Created volume successfully. Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-5e20b64a-2d53-4c4f-b0cf-6495adf41a70-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Lock "cinder-5e20b64a-2d53-4c4f-b0cf-6495adf41a70-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-quobyte-5e20b64a-2d53-4c4f-b0cf-6495adf41a70" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-5e20b64a-2d53-4c4f-b0cf-6495adf41a70" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ca44a-2e89-4dee-bb85-ccc29d402b74]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:57 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 Nov 05 12:13:57 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:57 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70" returned: 0 in 0.415s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:57 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70 Nov 05 12:13:57 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:58 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5e20b64a-2d53-4c4f-b0cf-6495adf41a70" returned: 0 in 0.275s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-5e20b64a-2d53-4c4f-b0cf-6495adf41a70" released by "delete_volume" :: held 0.759s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Created reservations ['af494e5e-1dc6-4cef-b5f5-017e95d3a517', 'baedd7c8-29da-48ec-9b75-e2ce55eb6a58', '267d0e06-9e8b-4ee0-bc9f-fe9d7da9ecfd', 'a6615f80-b8f7-4034-a3c6-5db45bd11739'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:58 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:13:58 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:58 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.265s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:13:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Deleted volume successfully. Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-41f394ac-2e56-4d13-8ecf-b424ebd08000 tempest-ProjectReaderTests-48738943 None] Lock "cinder-5e20b64a-2d53-4c4f-b0cf-6495adf41a70-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (665afb5f-2dde-4ea1-b6e6-0cfbc3bd284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182caaa4-fa31-4a6e-944b-53f1ee85ca3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182caaa4-fa31-4a6e-944b-53f1ee85ca3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429746929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b337b3d2-d5cd-4304-a480-8b496b7ab5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:59Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7930f4f9-ea1a-42a9-be2e-2939ce5e8779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7930f4f9-ea1a-42a9-be2e-2939ce5e8779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c1d4f0-bee9-4cbb-973f-b4ab1cdb7310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c1d4f0-bee9-4cbb-973f-b4ab1cdb7310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b337b3d2-d5cd-4304-a480-8b496b7ab5ec', 'volume_name': 'volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c47494-d9c1-4e30-8150-1e011e108f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c47494-d9c1-4e30-8150-1e011e108f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09a5c96-5ace-4388-b869-ca7fbb21af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:59 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Volume b337b3d2-d5cd-4304-a480-8b496b7ab5ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec', 'volume_size': 1} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429746929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b337b3d2-d5cd-4304-a480-8b496b7ab5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:59Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Creating volume b337b3d2-d5cd-4304-a480-8b496b7ab5ec {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:13:59 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:59 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec 1073741824 Nov 05 12:13:59 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:59 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec 1073741824" returned: 0 in 0.417s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:13:59 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec Nov 05 12:13:59 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:13:59 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec" returned: 0 in 0.301s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09a5c96-5ace-4388-b869-ca7fbb21af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d173a2cc-ab4a-458f-a3a4-b9056efbe8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:13:59 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Volume volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec (b337b3d2-d5cd-4304-a480-8b496b7ab5ec): created successfully Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d173a2cc-ab4a-458f-a3a4-b9056efbe8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:13:59 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (665afb5f-2dde-4ea1-b6e6-0cfbc3bd284c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:13:59 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e6f6996c-4911-4703-909f-95b12aae75e7 tempest-ProjectReaderTests-48738943 None] Created volume successfully. Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-b337b3d2-d5cd-4304-a480-8b496b7ab5ec-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Lock "cinder-b337b3d2-d5cd-4304-a480-8b496b7ab5ec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-quobyte-b337b3d2-d5cd-4304-a480-8b496b7ab5ec" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-b337b3d2-d5cd-4304-a480-8b496b7ab5ec" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0714b23a-539e-4969-9636-c47b95ec47aa]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:01 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec Nov 05 12:14:01 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:01 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec" returned: 0 in 0.428s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:01 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec Nov 05 12:14:01 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:02 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b337b3d2-d5cd-4304-a480-8b496b7ab5ec" returned: 0 in 0.284s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-b337b3d2-d5cd-4304-a480-8b496b7ab5ec" released by "delete_volume" :: held 0.770s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Created reservations ['f467141b-8695-4e07-a226-2ff9fb8e0eeb', 'df7931c1-cab9-4784-add9-3046073af5a0', '182f81bb-f867-4727-a222-0cccbc00b011', 'a8265f1f-275e-485a-8b41-e84e9cf81e5f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:02 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:14:02 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:02 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:14:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Deleted volume successfully. Nov 05 12:14:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c8d5ce82-d9cb-4bbb-828f-5d7cdcab2eca tempest-ProjectReaderTests-48738943 None] Lock "cinder-b337b3d2-d5cd-4304-a480-8b496b7ab5ec-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (4948f614-2c98-4a0d-8ebc-7af98c3fc1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a3eb9f-3fdb-4182-862a-207133747cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a3eb9f-3fdb-4182-862a-207133747cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454805959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7785c77c-4147-4c22-b310-3c06acd1e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:03Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7042d349-128f-400e-9984-10f12dea7310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7042d349-128f-400e-9984-10f12dea7310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f438242-888c-4a0f-95c3-df868e61e520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f438242-888c-4a0f-95c3-df868e61e520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7785c77c-4147-4c22-b310-3c06acd1e6b4', 'volume_name': 'volume-7785c77c-4147-4c22-b310-3c06acd1e6b4', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe17aa0-7ee7-46b7-8268-15df1d5e2ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe17aa0-7ee7-46b7-8268-15df1d5e2ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c226112-988b-44e3-8f61-1b33e5acb19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Volume 7785c77c-4147-4c22-b310-3c06acd1e6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7785c77c-4147-4c22-b310-3c06acd1e6b4', 'volume_size': 1} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454805959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7785c77c-4147-4c22-b310-3c06acd1e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:03Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Creating volume 7785c77c-4147-4c22-b310-3c06acd1e6b4 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:14:03 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:03 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 1073741824 Nov 05 12:14:03 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:03 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 1073741824" returned: 0 in 0.513s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:03 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 Nov 05 12:14:03 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:04 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4" returned: 0 in 0.383s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:14:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c226112-988b-44e3-8f61-1b33e5acb19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7785c77c-4147-4c22-b310-3c06acd1e6b4', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae66f70-99c4-4ead-9c86-1e8a3ffa82f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:04 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Volume volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 (7785c77c-4147-4c22-b310-3c06acd1e6b4): created successfully Nov 05 12:14:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae66f70-99c4-4ead-9c86-1e8a3ffa82f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (4948f614-2c98-4a0d-8ebc-7af98c3fc1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f32f3845-e3a9-4189-b19c-7a7211f8985f tempest-ProjectReaderTests-48738943 None] Created volume successfully. Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-7785c77c-4147-4c22-b310-3c06acd1e6b4-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Lock "cinder-7785c77c-4147-4c22-b310-3c06acd1e6b4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-quobyte-7785c77c-4147-4c22-b310-3c06acd1e6b4" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-7785c77c-4147-4c22-b310-3c06acd1e6b4" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf4bec-9ec0-4948-975a-14815233772d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:05 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 Nov 05 12:14:05 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:05 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4" returned: 0 in 0.440s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:05 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4 Nov 05 12:14:05 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:06 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-7785c77c-4147-4c22-b310-3c06acd1e6b4" returned: 0 in 0.284s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-7785c77c-4147-4c22-b310-3c06acd1e6b4" released by "delete_volume" :: held 0.776s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Created reservations ['4338dd87-73ea-441f-9b92-a313638382b1', '4510e5fb-5b8b-46c2-a83c-b8796183b862', '2423b764-50f4-4a39-98fb-75e01f23b397', '8122bc31-1aff-49bf-8f18-7a26e80d90ea'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:06 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:14:06 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:06 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.284s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:14:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Deleted volume successfully. Nov 05 12:14:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f87ae3f7-68e9-4a41-8d84-fce9a5fd434b tempest-ProjectReaderTests-48738943 None] Lock "cinder-7785c77c-4147-4c22-b310-3c06acd1e6b4-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (195260df-62e7-4294-a580-0b1fa29fb110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3492771-8ac0-4d32-a445-ef3f6caf4d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3492771-8ac0-4d32-a445-ef3f6caf4d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427290277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7c8ae4-567e-4764-9f4b-b7676f9636a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:07Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0093a7dd-9cd2-41bb-857b-cc9ff1013bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0093a7dd-9cd2-41bb-857b-cc9ff1013bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db89d3-78ea-4990-aee1-71e9ad458f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db89d3-78ea-4990-aee1-71e9ad458f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7c8ae4-567e-4764-9f4b-b7676f9636a1', 'volume_name': 'volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1cfbde-fca1-4b94-9154-20dc5f8e4420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1cfbde-fca1-4b94-9154-20dc5f8e4420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278697e0-57c3-48b8-92d4-fc10f267c59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:07 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Volume ef7c8ae4-567e-4764-9f4b-b7676f9636a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1', 'volume_size': 1} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427290277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7c8ae4-567e-4764-9f4b-b7676f9636a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc096fb1d56c4ef3b11aaaee28304185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:07Z,use_quota=True,user_id='91e13ee92e62422fb846c7e00fcba1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Creating volume ef7c8ae4-567e-4764-9f4b-b7676f9636a1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:14:07 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:07 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 1073741824 Nov 05 12:14:07 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:07 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 1073741824" returned: 0 in 0.462s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:07 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 Nov 05 12:14:07 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:07 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1" returned: 0 in 0.278s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278697e0-57c3-48b8-92d4-fc10f267c59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2ba0ef-35d0-4f70-a038-65c5584d21eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:07 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Volume volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 (ef7c8ae4-567e-4764-9f4b-b7676f9636a1): created successfully Nov 05 12:14:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2ba0ef-35d0-4f70-a038-65c5584d21eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:08 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Flow 'volume_create_manager' (195260df-62e7-4294-a580-0b1fa29fb110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-086a22ef-5e6c-4aec-97ae-e70f9385c756 tempest-ProjectReaderTests-48738943 None] Created volume successfully. Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-ef7c8ae4-567e-4764-9f4b-b7676f9636a1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Lock "cinder-ef7c8ae4-567e-4764-9f4b-b7676f9636a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Acquiring lock "cinder-quobyte-ef7c8ae4-567e-4764-9f4b-b7676f9636a1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-ef7c8ae4-567e-4764-9f4b-b7676f9636a1" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4b420-60eb-47da-8731-ebac8df245af]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:09 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 Nov 05 12:14:09 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:09 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1" returned: 0 in 0.396s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:09 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1 Nov 05 12:14:09 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:09 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ef7c8ae4-567e-4764-9f4b-b7676f9636a1" returned: 0 in 0.255s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Lock "cinder-quobyte-ef7c8ae4-567e-4764-9f4b-b7676f9636a1" released by "delete_volume" :: held 0.711s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:09 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Created reservations ['29462f8f-10e8-414a-a81b-fe1e34e36fa9', '874a133c-a6b7-425d-b719-e9ad057c3845', '2c3b13b0-9904-4796-95df-d97ba9b0bbb8', 'd87ed0cc-39c0-49cc-8238-a01b8bae20fe'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:10 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:14:10 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:10 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.414s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:14:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Deleted volume successfully. Nov 05 12:14:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-97a99b20-6000-4592-9d19-a73d922442db tempest-ProjectReaderTests-48738943 None] Lock "cinder-ef7c8ae4-567e-4764-9f4b-b7676f9636a1-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Flow 'volume_create_manager' (134a32b3-3457-4f9c-b741-9e8fbf29e78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cf4aa6-6a13-4755-8787-be0f2ffcbfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cf4aa6-6a13-4755-8787-be0f2ffcbfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1073054060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7fa519-eb6f-46cf-b235-90733ffb34ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a586e6e5a949c3be878f8adb381256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:18Z,use_quota=True,user_id='f176413ee23941c88ee919436f33c5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de78faec-d995-403d-b125-2370802f4380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de78faec-d995-403d-b125-2370802f4380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c583d4f5-8306-41ee-9099-6f3dcf9e94fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c583d4f5-8306-41ee-9099-6f3dcf9e94fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7fa519-eb6f-46cf-b235-90733ffb34ef', 'volume_name': 'volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5c2eaf-ec35-4edc-81dc-54cb40343557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5c2eaf-ec35-4edc-81dc-54cb40343557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42edabc2-b657-471f-ab52-3c5995092f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:17 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Volume fb7fa519-eb6f-46cf-b235-90733ffb34ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef', 'volume_size': 1} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1073054060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7fa519-eb6f-46cf-b235-90733ffb34ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a586e6e5a949c3be878f8adb381256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:18Z,use_quota=True,user_id='f176413ee23941c88ee919436f33c5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Creating volume fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:14:17 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:14:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:17 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef 1073741824 Nov 05 12:14:17 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:18 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef 1073741824" returned: 0 in 0.513s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:18 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef Nov 05 12:14:18 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:18 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef" returned: 0 in 0.332s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=130,cinder:SELECT=106,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42edabc2-b657-471f-ab52-3c5995092f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997a2730-0a55-4f76-b6b6-8cff2c902de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=94,cinder:INSERT=40,cinder:UPDATE=146,cinder:DELETE=14 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:14:18 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Volume volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef (fb7fa519-eb6f-46cf-b235-90733ffb34ef): created successfully Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997a2730-0a55-4f76-b6b6-8cff2c902de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Flow 'volume_create_manager' (134a32b3-3457-4f9c-b741-9e8fbf29e78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:18 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-91b76df7-081f-488f-a8c0-7724b6b3ffdb tempest-TestStampPattern-531094931 None] Created volume successfully. Nov 05 12:14:28 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Flow 'volume_create_manager' (ea0af353-f1a2-4ebf-8c64-277575946246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd465e33-d872-403a-a318-06cceb4cde72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd465e33-d872-403a-a318-06cceb4cde72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1817970679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2c51e5-930c-4a86-a552-c6991efa40a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b3dcb065f04ae7bc302f0012011732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='9bb6ad0de85d479082d50d0449c1cab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144080c3-27fb-4b83-91b1-f15b8625d2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144080c3-27fb-4b83-91b1-f15b8625d2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7495d1c-3718-485c-94fe-0e30341af434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7495d1c-3718-485c-94fe-0e30341af434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2c51e5-930c-4a86-a552-c6991efa40a3', 'volume_name': 'volume-8b2c51e5-930c-4a86-a552-c6991efa40a3', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a70b2-dfc3-49c8-9ba8-93904284b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6a70b2-dfc3-49c8-9ba8-93904284b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e81b5c4-46d9-4dd2-bad0-bb8fb2c3575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:39 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Volume 8b2c51e5-930c-4a86-a552-c6991efa40a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2c51e5-930c-4a86-a552-c6991efa40a3', 'volume_size': 1} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1817970679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2c51e5-930c-4a86-a552-c6991efa40a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b3dcb065f04ae7bc302f0012011732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='9bb6ad0de85d479082d50d0449c1cab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Creating volume 8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:14:39 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:39 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 1073741824 Nov 05 12:14:39 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:39 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 1073741824" returned: 0 in 0.480s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:39 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 Nov 05 12:14:39 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:40 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3" returned: 0 in 0.268s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:40 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:14:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e81b5c4-46d9-4dd2-bad0-bb8fb2c3575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2c51e5-930c-4a86-a552-c6991efa40a3', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af07697f-a306-4aa2-a6c6-0a16e4cbc8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:40 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Volume volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 (8b2c51e5-930c-4a86-a552-c6991efa40a3): created successfully Nov 05 12:14:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af07697f-a306-4aa2-a6c6-0a16e4cbc8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:40 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Flow 'volume_create_manager' (ea0af353-f1a2-4ebf-8c64-277575946246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:40 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5fc642e8-634e-4ae0-8f9b-07312c96afbf tempest-SnapshotDependencyTests-439821373 None] Created volume successfully. Nov 05 12:14:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Creating offline snapshot f59d5679-4c24-45e2-a2df-f667dcdef717 of volume 8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:14:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b58a6-0056-4448-829c-e41bb462d508]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:41 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 Nov 05 12:14:41 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:42 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3" returned: 0 in 0.422s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:42 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 1G Nov 05 12:14:42 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:42 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 1G" returned: 0 in 0.438s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:42 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 Nov 05 12:14:42 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:42 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717" returned: 0 in 0.352s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:42 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 is being set with open permissions: ugo+rw Nov 05 12:14:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:42 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 Nov 05 12:14:42 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:43 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:43 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.info Nov 05 12:14:43 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:43 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.info" returned: 0 in 0.260s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:43 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.info is being set with open permissions: ugo+rw Nov 05 12:14:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:43 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.info Nov 05 12:14:43 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:43 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.info" returned: 0 in 0.272s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-beea7704-af3c-4084-ad78-fc63de232271 tempest-SnapshotDependencyTests-439821373 None] Create snapshot completed successfully Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Flow 'volume_create_manager' (505e3ef6-7d17-40f9-bff0-6f56caf06739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af3dc5-7c98-4620-b585-35aa64a35aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29af3dc5-7c98-4620-b585-35aa64a35aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79a21ae-fd44-407f-b6ae-9f91d69f202f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b3dcb065f04ae7bc302f0012011732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f59d5679-4c24-45e2-a2df-f667dcdef717,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:45Z,use_quota=True,user_id='9bb6ad0de85d479082d50d0449c1cab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a013dda-6069-4c6d-b7e8-8e146aac1ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a013dda-6069-4c6d-b7e8-8e146aac1ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd3a07d-b36f-4e0c-943a-8131228caaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd3a07d-b36f-4e0c-943a-8131228caaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd79a21ae-fd44-407f-b6ae-9f91d69f202f', 'volume_name': 'volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f', 'volume_size': 1, 'snapshot_id': 'f59d5679-4c24-45e2-a2df-f667dcdef717'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9ecea9-d73f-4888-aac2-a26e053239a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9ecea9-d73f-4888-aac2-a26e053239a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be35002-56d2-4cc6-9712-38ddf2fd924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:45 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Volume d79a21ae-fd44-407f-b6ae-9f91d69f202f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f', 'volume_size': 1, 'snapshot_id': 'f59d5679-4c24-45e2-a2df-f667dcdef717'} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-quobyte-f59d5679-4c24-45e2-a2df-f667dcdef717-d79a21ae-fd44-407f-b6ae-9f91d69f202f" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-f59d5679-4c24-45e2-a2df-f667dcdef717-d79a21ae-fd44-407f-b6ae-9f91d69f202f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Creating volume d79a21ae-fd44-407f-b6ae-9f91d69f202f from snapshot f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-quobyte-d79a21ae-fd44-407f-b6ae-9f91d69f202f" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-d79a21ae-fd44-407f-b6ae-9f91d69f202f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] snapshot: f59d5679-4c24-45e2-a2df-f667dcdef717, volume: d79a21ae-fd44-407f-b6ae-9f91d69f202f, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae37307f-0770-4637-ba05-114317794432]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:45 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 Nov 05 12:14:45 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:45 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717" returned: 0 in 0.434s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2c51e5-930c-4a86-a552-c6991efa40a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d91d5-a6f8-4bf5-aff8-2ece5b8eb0aa]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:46 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 Nov 05 12:14:46 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:46 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3" returned: 0 in 0.364s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:14:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:14:46 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:14:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:46 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f Nov 05 12:14:46 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:52 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:14:52 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:52 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f" returned: 0 in 6.489s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:14:52 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Converted 1024.00 MB image at 157.76 MB/s Nov 05 12:14:52 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f is being set with open permissions: ugo+rw Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:52 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f Nov 05 12:14:52 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:52 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.442s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:14:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:14:53 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-d79a21ae-fd44-407f-b6ae-9f91d69f202f" released by "_copy_volume_from_snapshot" :: held 7.673s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-f59d5679-4c24-45e2-a2df-f667dcdef717-d79a21ae-fd44-407f-b6ae-9f91d69f202f" released by "_create_volume_from_snapshot" :: held 7.744s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.760s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be35002-56d2-4cc6-9712-38ddf2fd924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f', 'volume_size': 1, 'snapshot_id': 'f59d5679-4c24-45e2-a2df-f667dcdef717'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a80642-8862-4e0b-87df-89ac02af8325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b8bf3af3-7951-44c2-a4c5-2cbb2bbbebfd req-7f47285d-2bf3-4fb1-81ed-506f99b3a8a6 tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b8bf3af3-7951-44c2-a4c5-2cbb2bbbebfd req-7f47285d-2bf3-4fb1-81ed-506f99b3a8a6 tempest-TestStampPattern-531094931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:53 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Volume volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f (d79a21ae-fd44-407f-b6ae-9f91d69f202f): created successfully Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a80642-8862-4e0b-87df-89ac02af8325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Flow 'volume_create_manager' (505e3ef6-7d17-40f9-bff0-6f56caf06739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-b8bf3af3-7951-44c2-a4c5-2cbb2bbbebfd req-7f47285d-2bf3-4fb1-81ed-506f99b3a8a6 tempest-TestStampPattern-531094931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8dc7c1a0-670a-439b-8f29-97418f8e09e3 tempest-SnapshotDependencyTests-439821373 None] Created volume successfully. Nov 05 12:14:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-b8bf3af3-7951-44c2-a4c5-2cbb2bbbebfd req-7f47285d-2bf3-4fb1-81ed-506f99b3a8a6 tempest-TestStampPattern-531094931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80e183b1-b5a7-47fb-baec-1eabe8222f99', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:14:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-b8bf3af3-7951-44c2-a4c5-2cbb2bbbebfd req-7f47285d-2bf3-4fb1-81ed-506f99b3a8a6 tempest-TestStampPattern-531094931 None] attachment_update completed successfully. Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-f59d5679-4c24-45e2-a2df-f667dcdef717-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-f59d5679-4c24-45e2-a2df-f667dcdef717-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-quobyte-8b2c51e5-930c-4a86-a552-c6991efa40a3" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-8b2c51e5-930c-4a86-a552-c6991efa40a3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-quobyte-f59d5679-4c24-45e2-a2df-f667dcdef717" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-f59d5679-4c24-45e2-a2df-f667dcdef717" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Deleting offline snapshot f59d5679-4c24-45e2-a2df-f667dcdef717 of volume 8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] snapshot_file for this snap is: volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[742028bc-e4e4-4bdd-9aa4-1935cdf804fe]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:54 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 Nov 05 12:14:54 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:54 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717" returned: 0 in 0.369s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2c51e5-930c-4a86-a552-c6991efa40a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[97618a0e-0d07-407f-8852-cc520201f478]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:54 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 Nov 05 12:14:54 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:55 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3" returned: 0 in 0.533s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:55 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 Nov 05 12:14:55 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:55 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717" returned: 0 in 0.342s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:55 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717 Nov 05 12:14:55 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:55 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3.f59d5679-4c24-45e2-a2df-f667dcdef717" returned: 0 in 0.264s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-f59d5679-4c24-45e2-a2df-f667dcdef717" released by "_delete_snapshot" :: held 1.626s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-8b2c51e5-930c-4a86-a552-c6991efa40a3" released by "delete_snapshot" :: held 1.655s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Created reservations ['ada85b26-a8f1-46c2-99f2-08101845e4e4', '7265dffb-6f0c-440e-abbc-a0048d18da59', 'e1993817-4295-4ef6-9506-fbaef67e692b', '569abcdc-ca96-4bfa-abb9-21b485826345'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:14:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Delete snapshot completed successfully. Nov 05 12:14:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4201f767-c01e-4beb-86ba-01d53a2581f8 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-f59d5679-4c24-45e2-a2df-f667dcdef717-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-8b2c51e5-930c-4a86-a552-c6991efa40a3-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-8b2c51e5-930c-4a86-a552-c6991efa40a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-quobyte-8b2c51e5-930c-4a86-a552-c6991efa40a3" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-8b2c51e5-930c-4a86-a552-c6991efa40a3" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69d58c6-0b75-4d3b-8697-f5f9416583d2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:56 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 Nov 05 12:14:56 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:56 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:56 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3 Nov 05 12:14:56 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:57 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8b2c51e5-930c-4a86-a552-c6991efa40a3" returned: 0 in 0.280s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-8b2c51e5-930c-4a86-a552-c6991efa40a3" released by "delete_volume" :: held 0.757s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Created reservations ['a5ba33f8-0cce-4a9d-8c66-97c8563ae25e', '26f0d96a-00b0-4ca1-9c32-785ee1ff2c55', 'c44c10de-6233-4153-888c-6c753d9050da', '5c158c7e-f5ea-445d-b24d-fcac58d3386f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:57 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:14:57 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-d79a21ae-fd44-407f-b6ae-9f91d69f202f-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-d79a21ae-fd44-407f-b6ae-9f91d69f202f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "cinder-quobyte-d79a21ae-fd44-407f-b6ae-9f91d69f202f" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-d79a21ae-fd44-407f-b6ae-9f91d69f202f" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:14:57 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.305s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5804d875-d52b-44f1-b111-8bb5e6c26e8c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Deleted volume successfully. Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e2f65daf-6a48-42cd-86c2-4258f25b7fd1 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-8b2c51e5-930c-4a86-a552-c6991efa40a3-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:57 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f Nov 05 12:14:57 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:57 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:58 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f Nov 05 12:14:58 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:58 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d79a21ae-fd44-407f-b6ae-9f91d69f202f" returned: 0 in 0.299s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-quobyte-d79a21ae-fd44-407f-b6ae-9f91d69f202f" released by "delete_volume" :: held 0.753s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Created reservations ['d54993b8-4f14-48d2-83fb-a4fe8caf6cac', 'a698140f-305b-414a-a425-88dda9b178b4', '5dea937a-dcf1-4cc6-bd3e-31917341aae0', '19e0011c-2770-4488-921c-b6b8dc62369a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:58 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:14:58 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:14:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-da9a7861-d6cc-47db-ac2c-071bb2ebcca9 req-4fb76346-8611-4e02-995b-440584b1294b tempest-TestStampPattern-531094931 None] Terminate volume connection completed successfully. Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-da9a7861-d6cc-47db-ac2c-071bb2ebcca9 req-4fb76346-8611-4e02-995b-440584b1294b tempest-TestStampPattern-531094931 None] Deleting attachment 80e183b1-b5a7-47fb-baec-1eabe8222f99. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:14:58 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.315s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:14:58 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Deleted volume successfully. Nov 05 12:14:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6f0f3b35-fc9e-429f-8170-d44b80978635 tempest-SnapshotDependencyTests-439821373 None] Lock "cinder-d79a21ae-fd44-407f-b6ae-9f91d69f202f-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:14:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:14:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:14:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Creating offline snapshot ceeabe44-6e54-45d4-b6d1-061c58277aa2 of volume fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:14:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1388faff-cb40-4c3e-b428-f71f6f5772f7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:14:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:14:59 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef Nov 05 12:14:59 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:00 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef" returned: 0 in 0.409s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:00 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 1G Nov 05 12:15:00 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:00 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 1G" returned: 0 in 0.443s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:00 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 Nov 05 12:15:00 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:00 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2" returned: 0 in 0.338s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:00 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 is being set with open permissions: ugo+rw Nov 05 12:15:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:00 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 Nov 05 12:15:00 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:01 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2" returned: 0 in 0.252s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:01 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.info Nov 05 12:15:01 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:01 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.info" returned: 0 in 0.285s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:01 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.info is being set with open permissions: ugo+rw Nov 05 12:15:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:01 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.info Nov 05 12:15:01 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:01 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.info" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:15:01 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ed871dd6-09d6-4c6d-a39e-8d15a509fa7f tempest-TestStampPattern-531094931 None] Create snapshot completed successfully Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Flow 'volume_create_manager' (7de16bac-dd69-4c4d-b2c7-6f0b1d5df029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e12cbee-6f59-4977-bb68-7b93105fa5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e12cbee-6f59-4977-bb68-7b93105fa5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1758279069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b535267-d3ba-4071-bee1-5258b65cf616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a586e6e5a949c3be878f8adb381256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ceeabe44-6e54-45d4-b6d1-061c58277aa2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:10Z,use_quota=True,user_id='f176413ee23941c88ee919436f33c5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0c2ae8-3d09-49e7-8f58-76ef23594d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0c2ae8-3d09-49e7-8f58-76ef23594d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e835361-5efb-4888-b4d9-ca01a5802c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e835361-5efb-4888-b4d9-ca01a5802c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b535267-d3ba-4071-bee1-5258b65cf616', 'volume_name': 'volume-6b535267-d3ba-4071-bee1-5258b65cf616', 'volume_size': 1, 'snapshot_id': 'ceeabe44-6e54-45d4-b6d1-061c58277aa2'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dbc1c4-e1f7-47cb-a5bf-709606ab3813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dbc1c4-e1f7-47cb-a5bf-709606ab3813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b8756a-9f9b-4c3a-b4c6-d3926d92c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:15:09 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Volume 6b535267-d3ba-4071-bee1-5258b65cf616: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b535267-d3ba-4071-bee1-5258b65cf616', 'volume_size': 1, 'snapshot_id': 'ceeabe44-6e54-45d4-b6d1-061c58277aa2'} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-quobyte-ceeabe44-6e54-45d4-b6d1-061c58277aa2-6b535267-d3ba-4071-bee1-5258b65cf616" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-ceeabe44-6e54-45d4-b6d1-061c58277aa2-6b535267-d3ba-4071-bee1-5258b65cf616" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Creating volume 6b535267-d3ba-4071-bee1-5258b65cf616 from snapshot ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-quobyte-6b535267-d3ba-4071-bee1-5258b65cf616" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-6b535267-d3ba-4071-bee1-5258b65cf616" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] snapshot: ceeabe44-6e54-45d4-b6d1-061c58277aa2, volume: 6b535267-d3ba-4071-bee1-5258b65cf616, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[568e683a-bca0-4a7e-a63e-cc0c25ce3f03]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:15:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:10 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 Nov 05 12:15:10 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:10 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2" returned: 0 in 0.383s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3096ff-3a97-49d7-a359-67c83192a480]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:10 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef Nov 05 12:15:10 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:10 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef" returned: 0 in 0.385s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:15:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:10 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 Nov 05 12:15:10 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:19 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616" returned: 0 in 8.360s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:15:19 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Converted 1024.00 MB image at 122.47 MB/s Nov 05 12:15:19 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 is being set with open permissions: ugo+rw Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:19 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 Nov 05 12:15:19 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:19 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616" returned: 0 in 0.285s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-6b535267-d3ba-4071-bee1-5258b65cf616" released by "_copy_volume_from_snapshot" :: held 9.525s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-ceeabe44-6e54-45d4-b6d1-061c58277aa2-6b535267-d3ba-4071-bee1-5258b65cf616" released by "_create_volume_from_snapshot" :: held 9.637s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.665s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b8756a-9f9b-4c3a-b4c6-d3926d92c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b535267-d3ba-4071-bee1-5258b65cf616', 'volume_size': 1, 'snapshot_id': 'ceeabe44-6e54-45d4-b6d1-061c58277aa2'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc30d6-e5db-46d3-a5a9-cbc54320a696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:15:19 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Volume volume-6b535267-d3ba-4071-bee1-5258b65cf616 (6b535267-d3ba-4071-bee1-5258b65cf616): created successfully Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc30d6-e5db-46d3-a5a9-cbc54320a696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:15:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Flow 'volume_create_manager' (7de16bac-dd69-4c4d-b2c7-6f0b1d5df029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:15:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f48eec35-40dc-47d8-ae7b-be5480ef08e5 tempest-TestStampPattern-531094931 None] Created volume successfully. Nov 05 12:15:29 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=37,cinder:INSERT=10,cinder:SELECT=39,cinder:DELETE=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:15:29 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=39,cinder:UPDATE=33,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:15:52 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:15:52 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:15:52 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.266s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:15:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:16:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-e2e6ab1e-c9ec-473a-8d6e-4447dcc1e0d9 req-ac1453b9-dff0-4faa-bb9d-722e51ff2f45 tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-e2e6ab1e-c9ec-473a-8d6e-4447dcc1e0d9 req-ac1453b9-dff0-4faa-bb9d-722e51ff2f45 tempest-TestStampPattern-531094931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [req-e2e6ab1e-c9ec-473a-8d6e-4447dcc1e0d9 req-ac1453b9-dff0-4faa-bb9d-722e51ff2f45 tempest-TestStampPattern-531094931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-e2e6ab1e-c9ec-473a-8d6e-4447dcc1e0d9 req-ac1453b9-dff0-4faa-bb9d-722e51ff2f45 tempest-TestStampPattern-531094931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9', 'name': 'volume-6b535267-d3ba-4071-bee1-5258b65cf616', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d4103c7-dedf-4367-82b7-7ecfeee8c801', 'enforce_multipath': True} {{(pid=86942) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 12:16:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-e2e6ab1e-c9ec-473a-8d6e-4447dcc1e0d9 req-ac1453b9-dff0-4faa-bb9d-722e51ff2f45 tempest-TestStampPattern-531094931 None] attachment_update completed successfully. Nov 05 12:16:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [req-f611abc2-994f-4f14-b870-a7091ef5b033 req-a3658dfc-b4ea-406e-9bf1-16ab458da6e9 tempest-TestStampPattern-531094931 None] Terminate volume connection completed successfully. Nov 05 12:16:04 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [req-f611abc2-994f-4f14-b870-a7091ef5b033 req-a3658dfc-b4ea-406e-9bf1-16ab458da6e9 tempest-TestStampPattern-531094931 None] Deleting attachment 5d4103c7-dedf-4367-82b7-7ecfeee8c801. {{(pid=86942) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 12:16:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-6b535267-d3ba-4071-bee1-5258b65cf616-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Lock "cinder-6b535267-d3ba-4071-bee1-5258b65cf616-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-quobyte-6b535267-d3ba-4071-bee1-5258b65cf616" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-6b535267-d3ba-4071-bee1-5258b65cf616" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:08 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48bc3fb-ab57-44c2-850a-ff2ab41d85d2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:08 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 Nov 05 12:16:08 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:09 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616" returned: 0 in 0.361s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:09 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616 Nov 05 12:16:09 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:09 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6b535267-d3ba-4071-bee1-5258b65cf616" returned: 0 in 0.266s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-6b535267-d3ba-4071-bee1-5258b65cf616" released by "delete_volume" :: held 0.668s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Created reservations ['e7d06af6-0c8a-4a40-a7d4-1aafebfa4c46', '2ef0fd31-3d2c-4982-ac7a-e0a3c41e7bbd', '1b890713-73be-4c5d-ac16-0515ba966944', 'c82a92f4-6995-4d77-845f-ec40f7c3333a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:09 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:09 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:09 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.265s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Deleted volume successfully. Nov 05 12:16:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-93c28b77-6722-4ba1-a707-7c7764f8a0fb tempest-TestStampPattern-531094931 None] Lock "cinder-6b535267-d3ba-4071-bee1-5258b65cf616-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-ceeabe44-6e54-45d4-b6d1-061c58277aa2-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Lock "cinder-ceeabe44-6e54-45d4-b6d1-061c58277aa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-quobyte-fb7fa519-eb6f-46cf-b235-90733ffb34ef" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-fb7fa519-eb6f-46cf-b235-90733ffb34ef" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-quobyte-ceeabe44-6e54-45d4-b6d1-061c58277aa2" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-ceeabe44-6e54-45d4-b6d1-061c58277aa2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Deleting offline snapshot ceeabe44-6e54-45d4-b6d1-061c58277aa2 of volume fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] snapshot_file for this snap is: volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e30329-7552-45dd-89af-ebee47bfdcd3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:10 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 Nov 05 12:16:10 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:10 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[397541d4-ad5f-40f7-aaa2-57eb9c15aaef]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:10 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef Nov 05 12:16:10 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:11 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef" returned: 0 in 0.517s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:11 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 Nov 05 12:16:11 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:11 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2" returned: 0 in 0.318s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:11 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2 Nov 05 12:16:11 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:11 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef.ceeabe44-6e54-45d4-b6d1-061c58277aa2" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-ceeabe44-6e54-45d4-b6d1-061c58277aa2" released by "_delete_snapshot" :: held 1.525s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-fb7fa519-eb6f-46cf-b235-90733ffb34ef" released by "delete_snapshot" :: held 1.548s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Created reservations ['b021e54f-0a43-4a4b-9c62-8bafd9e25195', '96d0f2b0-e312-461d-a876-3bcd36bb84c4', '08ba98e0-b3b8-4359-956e-967f84c7c49a', 'ae5302db-5cca-415f-971f-ed5c3d03e348'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Delete snapshot completed successfully. Nov 05 12:16:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c890651-61f8-478c-9492-2ecf729c2703 tempest-TestStampPattern-531094931 None] Lock "cinder-ceeabe44-6e54-45d4-b6d1-061c58277aa2-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-fb7fa519-eb6f-46cf-b235-90733ffb34ef-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Lock "cinder-fb7fa519-eb6f-46cf-b235-90733ffb34ef-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Acquiring lock "cinder-quobyte-fb7fa519-eb6f-46cf-b235-90733ffb34ef" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-fb7fa519-eb6f-46cf-b235-90733ffb34ef" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff66077-39c5-44f1-a6d8-3623ab3bcb09]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:15 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef Nov 05 12:16:15 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:16 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef" returned: 0 in 0.361s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:16 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef Nov 05 12:16:16 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:16 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fb7fa519-eb6f-46cf-b235-90733ffb34ef" returned: 0 in 0.240s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Lock "cinder-quobyte-fb7fa519-eb6f-46cf-b235-90733ffb34ef" released by "delete_volume" :: held 0.661s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Created reservations ['ab31e2f0-135a-4cf9-aa04-c88edcc543da', 'f4829ddd-961c-4e20-ab21-411db056ca53', '5f5ce81f-d7c0-4a0f-a4ca-7df35630e70d', '3d7b73cd-5115-4d1d-841b-f3ae1b7da93a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:16 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:16 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:16 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.244s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Deleted volume successfully. Nov 05 12:16:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a73f553c-77b6-45f6-91a3-20f1deff4523 tempest-TestStampPattern-531094931 None] Lock "cinder-fb7fa519-eb6f-46cf-b235-90733ffb34ef-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:26 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=24,cinder:SELECT=28,cinder:INSERT=6 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:16:26 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (7ba6d622-448d-4b76-9c09-cd7f675b0e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d734cf7c-4fd4-448f-a2d5-292587ddb12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d734cf7c-4fd4-448f-a2d5-292587ddb12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-12777108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8b9795-2650-46c1-956f-98868bcd99d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:28Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67891cc-2eb0-47e0-8c69-e8754600728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67891cc-2eb0-47e0-8c69-e8754600728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143a13c1-9b16-43a4-8dfb-43da2d5a1ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143a13c1-9b16-43a4-8dfb-43da2d5a1ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8b9795-2650-46c1-956f-98868bcd99d9', 'volume_name': 'volume-5c8b9795-2650-46c1-956f-98868bcd99d9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6eebc80-ade6-40c6-848f-0d40b0683066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6eebc80-ade6-40c6-848f-0d40b0683066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85adc5f4-ee4c-45ef-87a7-07cdee4aee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Volume 5c8b9795-2650-46c1-956f-98868bcd99d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8b9795-2650-46c1-956f-98868bcd99d9', 'volume_size': 1} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-12777108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8b9795-2650-46c1-956f-98868bcd99d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:28Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Creating volume 5c8b9795-2650-46c1-956f-98868bcd99d9 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:28 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:28 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 1073741824 Nov 05 12:16:28 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (589546b9-3fce-4950-bc2e-12b576d7b91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0158d1-aeb0-4703-a70c-9082e58ab6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0158d1-aeb0-4703-a70c-9082e58ab6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568437179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd0266e-c3eb-4350-85a6-3f854af0068f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:29Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234230b5-45d5-450b-bcb4-f961ab4d699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234230b5-45d5-450b-bcb4-f961ab4d699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5208709b-5568-44a2-8d0b-6cc4cd9e5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5208709b-5568-44a2-8d0b-6cc4cd9e5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd0266e-c3eb-4350-85a6-3f854af0068f', 'volume_name': 'volume-dfd0266e-c3eb-4350-85a6-3f854af0068f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3ded30-a65d-4aae-aa84-577e5d61e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3ded30-a65d-4aae-aa84-577e5d61e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f008db40-37cd-412b-b54c-12b674d5707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:28 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Volume dfd0266e-c3eb-4350-85a6-3f854af0068f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd0266e-c3eb-4350-85a6-3f854af0068f', 'volume_size': 1} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:28 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 1073741824" returned: 0 in 0.487s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:28 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 Nov 05 12:16:28 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:28 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (5974c012-e522-4479-a01c-a5d8e9ba7083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a514c28-be80-42ee-bce6-a7fc9be47c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a514c28-be80-42ee-bce6-a7fc9be47c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1751869899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0fdfc1-d7e4-41bc-8105-ceb90ffec810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:29Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d6a913-ea86-4342-bf24-d54969f19d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d6a913-ea86-4342-bf24-d54969f19d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841911fa-6b87-4086-b2e4-cd8b40cf2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841911fa-6b87-4086-b2e4-cd8b40cf2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0fdfc1-d7e4-41bc-8105-ceb90ffec810', 'volume_name': 'volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4f57ba-ef61-43b4-9ec0-c827cd4118de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4f57ba-ef61-43b4-9ec0-c827cd4118de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436772f0-ecea-46e0-bdb3-18e15c206de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Volume de0fdfc1-d7e4-41bc-8105-ceb90ffec810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810', 'volume_size': 1} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:29 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9" returned: 0 in 0.289s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.463s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568437179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd0266e-c3eb-4350-85a6-3f854af0068f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:29Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Creating volume dfd0266e-c3eb-4350-85a6-3f854af0068f {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:29 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85adc5f4-ee4c-45ef-87a7-07cdee4aee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8b9795-2650-46c1-956f-98868bcd99d9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f 1073741824 Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b79500-8153-4d87-9608-4acfd89aadf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Volume volume-5c8b9795-2650-46c1-956f-98868bcd99d9 (5c8b9795-2650-46c1-956f-98868bcd99d9): created successfully Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b79500-8153-4d87-9608-4acfd89aadf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (7ba6d622-448d-4b76-9c09-cd7f675b0e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d6e50526-660b-4599-8346-85dc0319aeea tempest-CreateVolumesFromImageTest-719708727 None] Created volume successfully. Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (3135a113-a42e-43b7-b71e-36f7ee8218b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d67bba9-f884-4992-876b-a84abe7bad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d67bba9-f884-4992-876b-a84abe7bad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1970454276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7c12d9-ea3f-4fef-8b16-8da898e91e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:29Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f8f399-819a-4666-b26e-189f6d29390f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f8f399-819a-4666-b26e-189f6d29390f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d3d50a-ee21-41ae-87d9-e151a001d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d3d50a-ee21-41ae-87d9-e151a001d97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7c12d9-ea3f-4fef-8b16-8da898e91e68', 'volume_name': 'volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f63b279-8936-4745-a904-be0d1d15556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f63b279-8936-4745-a904-be0d1d15556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d406a55-d37b-460b-aca6-472bdc67e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Volume cb7c12d9-ea3f-4fef-8b16-8da898e91e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68', 'volume_size': 1} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:29 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f 1073741824" returned: 0 in 0.520s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:29 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f Nov 05 12:16:29 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (72c3d34b-f914-4721-8a91-3c8a4d8e1df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57e8aa6-f7c7-4c4b-9d7e-af29733906fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57e8aa6-f7c7-4c4b-9d7e-af29733906fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-648661830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb2c5aa-268c-4683-a5a3-3a362b9276a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:30Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d372a67-fa7c-4b45-b0aa-a1adafef3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d372a67-fa7c-4b45-b0aa-a1adafef3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d0b1d9-2b25-4d99-b57d-83c3f0c898c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d0b1d9-2b25-4d99-b57d-83c3f0c898c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cb2c5aa-268c-4683-a5a3-3a362b9276a0', 'volume_name': 'volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59dd476-4181-47be-8518-70a8440eb682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59dd476-4181-47be-8518-70a8440eb682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235327d7-6d54-4354-b509-60f53c676954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Volume 5cb2c5aa-268c-4683-a5a3-3a362b9276a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0', 'volume_size': 1} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:29 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f" returned: 0 in 0.272s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1751869899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0fdfc1-d7e4-41bc-8105-ceb90ffec810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:29Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Creating volume de0fdfc1-d7e4-41bc-8105-ceb90ffec810 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:29 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f008db40-37cd-412b-b54c-12b674d5707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd0266e-c3eb-4350-85a6-3f854af0068f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:30 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 1073741824 Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b55b308-9836-43b8-8e92-4164b16c83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:30 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Volume volume-dfd0266e-c3eb-4350-85a6-3f854af0068f (dfd0266e-c3eb-4350-85a6-3f854af0068f): created successfully Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b55b308-9836-43b8-8e92-4164b16c83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (589546b9-3fce-4950-bc2e-12b576d7b91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-306bf0c5-a6cb-440d-b7dc-e436d3a4d282 tempest-CreateVolumesFromImageTest-719708727 None] Created volume successfully. Nov 05 12:16:30 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 1073741824" returned: 0 in 0.401s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:30 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 Nov 05 12:16:30 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:30 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1970454276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7c12d9-ea3f-4fef-8b16-8da898e91e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:29Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Creating volume cb7c12d9-ea3f-4fef-8b16-8da898e91e68 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:30 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:30 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 1073741824 Nov 05 12:16:30 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436772f0-ecea-46e0-bdb3-18e15c206de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bdc3a0-7586-4782-bf60-cca104077dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Volume volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 (de0fdfc1-d7e4-41bc-8105-ceb90ffec810): created successfully Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bdc3a0-7586-4782-bf60-cca104077dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (5974c012-e522-4479-a01c-a5d8e9ba7083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1e06ea10-3f47-475c-9d4a-cff75d4e95d6 tempest-CreateVolumesFromImageTest-719708727 None] Created volume successfully. Nov 05 12:16:31 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 1073741824" returned: 0 in 0.419s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:31 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 Nov 05 12:16:31 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:31 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68" returned: 0 in 0.241s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-648661830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb2c5aa-268c-4683-a5a3-3a362b9276a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef9497bb3e4f3e96cb1d662fd9a449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:30Z,use_quota=True,user_id='be4d47478093419da354ff1b91a90f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Creating volume 5cb2c5aa-268c-4683-a5a3-3a362b9276a0 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:31 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d406a55-d37b-460b-aca6-472bdc67e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d818d295-4591-4da3-9f84-1b892b01aa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:31 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 1073741824 Nov 05 12:16:31 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Volume volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 (cb7c12d9-ea3f-4fef-8b16-8da898e91e68): created successfully Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d818d295-4591-4da3-9f84-1b892b01aa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (3135a113-a42e-43b7-b71e-36f7ee8218b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fd1e1936-4cfd-466b-90f5-ba0dc4fb7a05 tempest-CreateVolumesFromImageTest-719708727 None] Created volume successfully. Nov 05 12:16:31 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 1073741824" returned: 0 in 0.427s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:31 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 Nov 05 12:16:31 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:32 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0" returned: 0 in 0.247s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:32 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235327d7-6d54-4354-b509-60f53c676954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37499f29-39aa-4071-a74b-52c16ed9fde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:32 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Volume volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 (5cb2c5aa-268c-4683-a5a3-3a362b9276a0): created successfully Nov 05 12:16:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37499f29-39aa-4071-a74b-52c16ed9fde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:32 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Flow 'volume_create_manager' (72c3d34b-f914-4721-8a91-3c8a4d8e1df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fda291f2-b966-4490-9487-b4190934d892 tempest-CreateVolumesFromImageTest-719708727 None] Created volume successfully. Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-5cb2c5aa-268c-4683-a5a3-3a362b9276a0-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-5cb2c5aa-268c-4683-a5a3-3a362b9276a0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-quobyte-5cb2c5aa-268c-4683-a5a3-3a362b9276a0" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-5cb2c5aa-268c-4683-a5a3-3a362b9276a0" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c353ddca-6b58-4b35-994e-632c81f80964]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:33 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 Nov 05 12:16:33 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:33 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0" returned: 0 in 0.376s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:33 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0 Nov 05 12:16:33 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:33 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5cb2c5aa-268c-4683-a5a3-3a362b9276a0" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-5cb2c5aa-268c-4683-a5a3-3a362b9276a0" released by "delete_volume" :: held 0.664s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Created reservations ['c392faf7-ee7c-4f9c-8d3b-fd68e37043d5', 'eb699160-477a-48b1-96fb-bcd61236c26c', '95b763bf-7136-44e5-b481-5ed638bfc25e', '4754180e-2930-4699-b413-bdbb4f1930fb'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:33 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:33 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:34 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.242s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Deleted volume successfully. Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-daf72425-b47d-4a6d-8001-5a23e2307d08 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-5cb2c5aa-268c-4683-a5a3-3a362b9276a0-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-cb7c12d9-ea3f-4fef-8b16-8da898e91e68-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-cb7c12d9-ea3f-4fef-8b16-8da898e91e68-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-quobyte-cb7c12d9-ea3f-4fef-8b16-8da898e91e68" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-cb7c12d9-ea3f-4fef-8b16-8da898e91e68" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecacd1b7-a3a7-45a4-85a3-632208a75b05]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:34 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 Nov 05 12:16:34 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:34 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68" returned: 0 in 0.358s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:34 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68 Nov 05 12:16:34 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:34 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cb7c12d9-ea3f-4fef-8b16-8da898e91e68" returned: 0 in 0.243s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-cb7c12d9-ea3f-4fef-8b16-8da898e91e68" released by "delete_volume" :: held 0.639s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Created reservations ['b327684f-d0ba-403d-8911-37f4b7131391', '47dd6a0f-99bb-453f-b72b-d9237705ff9e', 'db924005-cbd7-4af4-b7f8-7787b76a75a8', 'af39d70b-a4a5-4dd2-b56d-2d6df8dae1b3'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:35 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:35 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:35 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.239s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:35 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Deleted volume successfully. Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-42e22d54-882b-4646-bc0f-92d0710e5392 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-cb7c12d9-ea3f-4fef-8b16-8da898e91e68-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-de0fdfc1-d7e4-41bc-8105-ceb90ffec810-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-de0fdfc1-d7e4-41bc-8105-ceb90ffec810-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-quobyte-de0fdfc1-d7e4-41bc-8105-ceb90ffec810" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-de0fdfc1-d7e4-41bc-8105-ceb90ffec810" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea7a64-b6cd-45ea-ad7d-70b04d3707ff]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:35 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 Nov 05 12:16:35 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:35 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810" returned: 0 in 0.357s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:35 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810 Nov 05 12:16:35 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:36 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-de0fdfc1-d7e4-41bc-8105-ceb90ffec810" returned: 0 in 0.243s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-de0fdfc1-d7e4-41bc-8105-ceb90ffec810" released by "delete_volume" :: held 0.642s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Created reservations ['b4b7e8df-63f8-44bc-bd51-d6bfa575210e', '98c91378-bd03-43d7-9f4e-059f873f96c5', '99fb505a-bb22-4918-b426-aec39d149dd6', 'f7b1617e-d1b1-4b18-8add-9ca29fdefef2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:36 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:36 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:36 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.235s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:36 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Deleted volume successfully. Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-22d454cb-887d-4c79-b801-4a4384e95e43 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-de0fdfc1-d7e4-41bc-8105-ceb90ffec810-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-dfd0266e-c3eb-4350-85a6-3f854af0068f-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-dfd0266e-c3eb-4350-85a6-3f854af0068f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-quobyte-dfd0266e-c3eb-4350-85a6-3f854af0068f" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-dfd0266e-c3eb-4350-85a6-3f854af0068f" acquired by "delete_volume" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3acd53-656e-4691-bca3-9cd95bb43f95]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:36 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f Nov 05 12:16:36 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:37 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f" returned: 0 in 0.353s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:37 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f Nov 05 12:16:37 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:37 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-dfd0266e-c3eb-4350-85a6-3f854af0068f" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-dfd0266e-c3eb-4350-85a6-3f854af0068f" released by "delete_volume" :: held 0.644s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Created reservations ['d1bd2645-c315-4b49-aead-d733c8ca5df6', 'b30f9dc9-0686-4508-af70-608e60cbdb20', 'c0cf7865-8af4-4f30-9f0e-ec476e70b051', 'c2c113a0-0156-426b-97a7-feebca4c8f39'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:37 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:37 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:37 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.247s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Deleted volume successfully. Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3bebd815-2bfc-4786-affd-805fe8974d1f tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-dfd0266e-c3eb-4350-85a6-3f854af0068f-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-5c8b9795-2650-46c1-956f-98868bcd99d9-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-5c8b9795-2650-46c1-956f-98868bcd99d9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "cinder-quobyte-5c8b9795-2650-46c1-956f-98868bcd99d9" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-5c8b9795-2650-46c1-956f-98868bcd99d9" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4e61e0-c4e6-4b70-b7e7-ffd77ec1bcc9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:38 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 Nov 05 12:16:38 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:38 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9" returned: 0 in 0.355s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:38 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9 Nov 05 12:16:38 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:38 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5c8b9795-2650-46c1-956f-98868bcd99d9" returned: 0 in 0.245s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-quobyte-5c8b9795-2650-46c1-956f-98868bcd99d9" released by "delete_volume" :: held 0.641s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Created reservations ['c44d39f1-c788-4cb6-87f9-108ce4418e2a', 'a01652be-acc3-463a-80a2-b6435b5b445f', '994db4ab-ddd5-4c40-88da-6711b0554e86', '7139f059-b1d7-4b24-aa07-349b20cc21c9'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:38 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:38 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:38 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Deleted volume successfully. Nov 05 12:16:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0ad77b08-54fb-417c-9e9a-d5d7699f2b61 tempest-CreateVolumesFromImageTest-719708727 None] Lock "cinder-5c8b9795-2650-46c1-956f-98868bcd99d9-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (92795210-70dd-4cee-859a-68106b68397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16357da-7829-4d51-af5f-350550338ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16357da-7829-4d51-af5f-350550338ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530887397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1809b05-1cb3-41e8-9320-f9a3ebc91d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:42Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722152c9-1e7c-45de-82e7-2c81579f3776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722152c9-1e7c-45de-82e7-2c81579f3776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951e923c-e68a-4b40-90f8-aac44550ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951e923c-e68a-4b40-90f8-aac44550ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1809b05-1cb3-41e8-9320-f9a3ebc91d36', 'volume_name': 'volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a21a387-ed2c-4a46-ba70-78c7a0cf6313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a21a387-ed2c-4a46-ba70-78c7a0cf6313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190044db-9976-40a3-8832-522f21f90a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume d1809b05-1cb3-41e8-9320-f9a3ebc91d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36', 'volume_size': 1} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530887397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1809b05-1cb3-41e8-9320-f9a3ebc91d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:42Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Creating volume d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:41 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:41 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 1073741824 Nov 05 12:16:41 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:42 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 1073741824" returned: 0 in 0.401s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:42 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 Nov 05 12:16:42 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:42 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" returned: 0 in 0.230s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190044db-9976-40a3-8832-522f21f90a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae43376f-7ec7-447e-a011-ade6106c1ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 (d1809b05-1cb3-41e8-9320-f9a3ebc91d36): created successfully Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae43376f-7ec7-447e-a011-ade6106c1ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (92795210-70dd-4cee-859a-68106b68397a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-10711193-96a1-4617-a8f5-e17b1a9474c7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created volume successfully. Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Creating offline snapshot 3723c339-41e2-4f45-a88d-a25cbf909528 of volume d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48b0fef-bc65-43a5-9b0e-28791e0fb685]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:42 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 Nov 05 12:16:42 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:43 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" returned: 0 in 0.350s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:43 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 1G Nov 05 12:16:43 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:43 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 1G" returned: 0 in 0.379s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:43 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 Nov 05 12:16:43 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:43 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528" returned: 0 in 0.284s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:43 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 is being set with open permissions: ugo+rw Nov 05 12:16:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:43 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 Nov 05 12:16:43 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:44 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:44 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.info Nov 05 12:16:44 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:44 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.info" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:44 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.info is being set with open permissions: ugo+rw Nov 05 12:16:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:44 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.info Nov 05 12:16:44 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:44 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.info" returned: 0 in 0.240s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:44 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8862c945-4a76-48a3-8a77-ac6ff382891d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Create snapshot completed successfully Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (088c2d15-8633-4f2f-aa4e-d83ea8b96890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc46d98-1426-4a92-a70c-de114e2ce28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc46d98-1426-4a92-a70c-de114e2ce28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037530597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0a42d5-aed6-42c3-bf19-ac3119ce49ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:45Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4996c1d9-6aac-42f9-9d59-0b12135a4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4996c1d9-6aac-42f9-9d59-0b12135a4475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3ded83-d5ec-4306-a2ed-3d296a8caf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3ded83-d5ec-4306-a2ed-3d296a8caf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0a42d5-aed6-42c3-bf19-ac3119ce49ae', 'volume_name': 'volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595d12ab-1a62-4d90-84c5-b2439b01e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595d12ab-1a62-4d90-84c5-b2439b01e32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc035c9-102a-4857-abe3-10783e73ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume 2b0a42d5-aed6-42c3-bf19-ac3119ce49ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae', 'volume_size': 1} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037530597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0a42d5-aed6-42c3-bf19-ac3119ce49ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:45Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Creating volume 2b0a42d5-aed6-42c3-bf19-ac3119ce49ae {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:45 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:45 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae 1073741824 Nov 05 12:16:45 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (59449b4b-496f-47f4-be41-3030e2eb2c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2375b7b-8ecd-425f-9578-8462a9ee4263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2375b7b-8ecd-425f-9578-8462a9ee4263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139842079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:46Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3482db-5847-438e-bcd5-1ae5c2caa7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3482db-5847-438e-bcd5-1ae5c2caa7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c032610e-d528-4c54-b734-8bc6ad825093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c032610e-d528-4c54-b734-8bc6ad825093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70', 'volume_name': 'volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae4551-99e4-471b-af42-6698858038af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae4551-99e4-471b-af42-6698858038af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a18688-7770-48cf-b5bf-0ed88000c3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:45 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume 6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70', 'volume_size': 1} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:45 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae 1073741824" returned: 0 in 0.525s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:45 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae Nov 05 12:16:45 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (62bfe39a-1a6d-48a5-ab52-5462f65d3180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d6fd8a-48b1-4211-b3f1-ffa461016da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d6fd8a-48b1-4211-b3f1-ffa461016da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813827472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b252364a-f6bf-47f2-84af-48bccdc6f897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:46Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68626947-5621-4cb5-870f-425eafc0340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68626947-5621-4cb5-870f-425eafc0340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca8a77-bddf-49c9-aa21-c33ac13a11a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca8a77-bddf-49c9-aa21-c33ac13a11a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b252364a-f6bf-47f2-84af-48bccdc6f897', 'volume_name': 'volume-b252364a-f6bf-47f2-84af-48bccdc6f897', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae398bd-8619-4904-a2a6-80beec674320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae398bd-8619-4904-a2a6-80beec674320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a36cdd5-e99b-4b6f-834e-9975cca934a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume b252364a-f6bf-47f2-84af-48bccdc6f897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b252364a-f6bf-47f2-84af-48bccdc6f897', 'volume_size': 1} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:46 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae" returned: 0 in 0.289s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139842079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:46Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Creating volume 6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:46 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc035c9-102a-4857-abe3-10783e73ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b951c6d1-13b1-4d51-9563-7ee5c09e8f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 1073741824 Nov 05 12:16:46 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae (2b0a42d5-aed6-42c3-bf19-ac3119ce49ae): created successfully Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b951c6d1-13b1-4d51-9563-7ee5c09e8f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (088c2d15-8633-4f2f-aa4e-d83ea8b96890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7a9a1b55-808f-4da6-b5c8-cec5fd2eccf3 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created volume successfully. Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (6049eeee-face-447c-8ef3-2f0d3635b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be05ea9-9e16-46fc-a32d-06168c9fda12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be05ea9-9e16-46fc-a32d-06168c9fda12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1364147821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bbb9a9-a793-492f-a3da-882ee5e0b5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:46Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6942709e-2a30-4ab2-9427-e8cc67a5e1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6942709e-2a30-4ab2-9427-e8cc67a5e1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f6abde-c399-4ff4-a48e-27085dc67891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f6abde-c399-4ff4-a48e-27085dc67891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3bbb9a9-a793-492f-a3da-882ee5e0b5dc', 'volume_name': 'volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e34388-d1a6-4f44-b65e-abae65cbdf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e34388-d1a6-4f44-b65e-abae65cbdf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa804c41-1351-48fa-826a-44c8bd3f63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume f3bbb9a9-a793-492f-a3da-882ee5e0b5dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc', 'volume_size': 1} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:46 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 1073741824" returned: 0 in 0.539s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (3acfb265-77fe-4876-bde3-d8c0d20edb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6db9e1-2e93-45ef-9abb-b076c20e4c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6db9e1-2e93-45ef-9abb-b076c20e4c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-309495693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88f41ec-b8b4-4bc3-91a4-3fac420bc062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:47Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c34d120-93c9-43de-b954-aca4558f9add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c34d120-93c9-43de-b954-aca4558f9add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607e2935-037b-4748-ba94-0952bfbcdf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607e2935-037b-4748-ba94-0952bfbcdf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88f41ec-b8b4-4bc3-91a4-3fac420bc062', 'volume_name': 'volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84fd794-9f2f-467e-8e2c-8cbe55631bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84fd794-9f2f-467e-8e2c-8cbe55631bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dc99ed-3a7c-4516-9a58-6889c3107131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume f88f41ec-b8b4-4bc3-91a4-3fac420bc062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062', 'volume_size': 1} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:46 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 Nov 05 12:16:46 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:47 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70" returned: 0 in 0.240s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813827472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b252364a-f6bf-47f2-84af-48bccdc6f897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:46Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Creating volume b252364a-f6bf-47f2-84af-48bccdc6f897 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:47 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a18688-7770-48cf-b5bf-0ed88000c3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f06497-402d-48f2-8852-e33a0d3a56a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:47 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 1073741824 Nov 05 12:16:47 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 (6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70): created successfully Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f06497-402d-48f2-8852-e33a0d3a56a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (59449b4b-496f-47f4-be41-3030e2eb2c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-884a8a1a-a8fd-484a-9587-063d45296d34 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created volume successfully. Nov 05 12:16:47 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 1073741824" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:47 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 Nov 05 12:16:47 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:47 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897" returned: 0 in 0.260s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1364147821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bbb9a9-a793-492f-a3da-882ee5e0b5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:46Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Creating volume f3bbb9a9-a793-492f-a3da-882ee5e0b5dc {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:47 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a36cdd5-e99b-4b6f-834e-9975cca934a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b252364a-f6bf-47f2-84af-48bccdc6f897', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:47 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc 1073741824 Nov 05 12:16:47 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25691a14-9cd2-4456-ba24-b878e1ea1cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume volume-b252364a-f6bf-47f2-84af-48bccdc6f897 (b252364a-f6bf-47f2-84af-48bccdc6f897): created successfully Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25691a14-9cd2-4456-ba24-b878e1ea1cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (62bfe39a-1a6d-48a5-ab52-5462f65d3180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e249fe4e-5033-472c-a8f3-40bfd25dc312 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created volume successfully. Nov 05 12:16:48 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc 1073741824" returned: 0 in 0.411s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:48 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc Nov 05 12:16:48 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:48 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc" returned: 0 in 0.242s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-309495693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88f41ec-b8b4-4bc3-91a4-3fac420bc062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23b8bbd07fb40219397d2e758659c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:47Z,use_quota=True,user_id='e0aa708d7bce4248b61b37389e9718d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Creating volume f88f41ec-b8b4-4bc3-91a4-3fac420bc062 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:16:48 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa804c41-1351-48fa-826a-44c8bd3f63da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:48 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 1073741824 Nov 05 12:16:48 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4d2321-3ce4-4bfd-901d-1fb3bae6ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc (f3bbb9a9-a793-492f-a3da-882ee5e0b5dc): created successfully Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4d2321-3ce4-4bfd-901d-1fb3bae6ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (6049eeee-face-447c-8ef3-2f0d3635b62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-58ec9f74-7f47-4213-a39d-007cf3d6a0eb tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created volume successfully. Nov 05 12:16:49 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 1073741824" returned: 0 in 0.464s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:49 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 Nov 05 12:16:49 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:49 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062" returned: 0 in 0.241s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dc99ed-3a7c-4516-9a58-6889c3107131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebb198d-64ac-443d-a266-996cd7ea0191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:16:49 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Volume volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 (f88f41ec-b8b4-4bc3-91a4-3fac420bc062): created successfully Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebb198d-64ac-443d-a266-996cd7ea0191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:16:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Flow 'volume_create_manager' (3acfb265-77fe-4876-bde3-d8c0d20edb15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:16:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e3d17a92-fe1d-42ff-887c-28adf5adf237 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created volume successfully. Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-f88f41ec-b8b4-4bc3-91a4-3fac420bc062-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-f88f41ec-b8b4-4bc3-91a4-3fac420bc062-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-f88f41ec-b8b4-4bc3-91a4-3fac420bc062" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-f88f41ec-b8b4-4bc3-91a4-3fac420bc062" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e710a4-f9e9-429e-b8cb-77deb1589fe5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:50 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 Nov 05 12:16:50 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:50 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062" returned: 0 in 0.348s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:50 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062 Nov 05 12:16:50 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:50 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f88f41ec-b8b4-4bc3-91a4-3fac420bc062" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-f88f41ec-b8b4-4bc3-91a4-3fac420bc062" released by "delete_volume" :: held 0.633s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created reservations ['4e39092f-623d-41a2-8eb3-363bcde395d8', '7ab1fc70-6c8f-42c9-a179-4b7ba519d265', 'c02c20eb-b9ab-4c75-8551-e9ad874f5296', '51416f96-ac24-4d7b-af90-b09dfa2ceee0'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:51 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:51 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:51 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.233s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Deleted volume successfully. Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-da96e863-83db-4f7f-a909-7abd096834a0 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-f88f41ec-b8b4-4bc3-91a4-3fac420bc062-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60c31c2-6d71-469c-8560-7c7a0a1ea990]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:51 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc Nov 05 12:16:51 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:51 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc" returned: 0 in 0.353s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:51 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc Nov 05 12:16:51 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:51 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc" returned: 0 in 0.236s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc" released by "delete_volume" :: held 0.635s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created reservations ['57d1e739-2c69-4001-ad27-b8e37baa5645', '5f6a7288-2c2b-40e5-83e0-2f4cb8668bcc', '058b77f9-a334-424b-85dd-8fd979b96ea5', 'f17e25cf-b5aa-41f3-8613-0ddf36d354ce'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:52 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:52 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:52 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.247s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Deleted volume successfully. Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-cb4890e5-f1b2-4b45-8686-59322959d3e7 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-f3bbb9a9-a793-492f-a3da-882ee5e0b5dc-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-b252364a-f6bf-47f2-84af-48bccdc6f897-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-b252364a-f6bf-47f2-84af-48bccdc6f897-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:52 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:52 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-b252364a-f6bf-47f2-84af-48bccdc6f897" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-b252364a-f6bf-47f2-84af-48bccdc6f897" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc90095-73aa-4ba0-85fc-60e6b9f5af85]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:52 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 Nov 05 12:16:52 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:52 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.255s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:16:52 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897" returned: 0 in 0.372s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:52 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897 Nov 05 12:16:52 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:53 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b252364a-f6bf-47f2-84af-48bccdc6f897" returned: 0 in 0.240s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-b252364a-f6bf-47f2-84af-48bccdc6f897" released by "delete_volume" :: held 0.654s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created reservations ['48370636-cb4e-4f60-859e-7499ce94a1ac', 'd03e8e51-dc7f-47f9-a8e6-f948ed57e503', 'a257eb50-bf94-4a39-9691-4896c0259aaf', 'f8285d35-9c01-499a-943e-0e5f12ddc4c2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:53 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:53 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:53 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.245s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Deleted volume successfully. Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b4f2ecfd-f9b5-4d47-a5f4-ffaa89a95196 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-b252364a-f6bf-47f2-84af-48bccdc6f897-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70" acquired by "delete_volume" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2354660-6728-4a42-86a5-88614aeecc41]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:53 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 Nov 05 12:16:53 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:54 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70" returned: 0 in 0.352s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:54 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70 Nov 05 12:16:54 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:54 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70" returned: 0 in 0.251s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70" released by "delete_volume" :: held 0.645s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created reservations ['4b75ba9a-8ec9-414e-a9e2-d5dcdf5c3d19', '89773cd1-efb6-4fe7-bc24-3aaf72dc3dbb', '49562498-2fc1-4353-a005-ec2a45ae5c0e', '32f04fef-d691-4302-84e9-f124a83f0319'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:54 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:54 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:54 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.241s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:54 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Deleted volume successfully. Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a03a1685-75d0-4c08-8cc5-7a9fcb182828 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-6c8d7e25-d7fd-48a1-8cd5-c5e19cbcdf70-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae" acquired by "delete_volume" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be7eb5-31c4-4590-8554-f92ad6fe1fee]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:54 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae Nov 05 12:16:54 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:55 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae" returned: 0 in 0.345s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:55 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae Nov 05 12:16:55 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:55 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae" returned: 0 in 0.232s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae" released by "delete_volume" :: held 0.618s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created reservations ['d31646fd-d938-4c88-95ec-d65d55804d73', '25a1f09a-c1d7-41cf-9cb1-8bf3d049d1f1', '4c629b89-0dc3-4ac0-8700-31f82caeaf4e', 'e4ddec96-af5a-42e7-9579-cd210867710c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:55 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:55 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:55 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.243s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Deleted volume successfully. Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-28f1e3e2-eabd-4aaf-aedb-040776076058 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-2b0a42d5-aed6-42c3-bf19-ac3119ce49ae-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-3723c339-41e2-4f45-a88d-a25cbf909528-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-3723c339-41e2-4f45-a88d-a25cbf909528-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-3723c339-41e2-4f45-a88d-a25cbf909528" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-3723c339-41e2-4f45-a88d-a25cbf909528" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Deleting offline snapshot 3723c339-41e2-4f45-a88d-a25cbf909528 of volume d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] snapshot_file for this snap is: volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05e304-de45-48cc-8801-06be985773c4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:56 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 Nov 05 12:16:56 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:56 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528" returned: 0 in 0.377s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc218b-d9b8-4097-ac7a-2ca44eb8b4e2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:56 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 Nov 05 12:16:56 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:56 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" returned: 0 in 0.364s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:56 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 Nov 05 12:16:56 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:57 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528" returned: 0 in 0.346s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:57 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528 Nov 05 12:16:57 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:57 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36.3723c339-41e2-4f45-a88d-a25cbf909528" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-3723c339-41e2-4f45-a88d-a25cbf909528" released by "_delete_snapshot" :: held 1.437s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" released by "delete_snapshot" :: held 1.460s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:57 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created reservations ['0eeb41d8-80c7-4666-9340-38123bb11899', '194ba76c-4c13-42b9-b369-48e33ff83b44', 'c08ef554-96c8-4b2c-b899-dc73b0a03658', '617f1409-3d3e-44f8-a374-da6a9d6f3f23'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Delete snapshot completed successfully. Nov 05 12:16:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4d5ad401-c8ea-429c-a5d7-c21e9e5be0d1 tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-3723c339-41e2-4f45-a88d-a25cbf909528-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-d1809b05-1cb3-41e8-9320-f9a3ebc91d36-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-d1809b05-1cb3-41e8-9320-f9a3ebc91d36-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "cinder-quobyte-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" acquired by "delete_volume" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d470ac49-5ad6-4a72-bdea-72ab667487e3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:58 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 Nov 05 12:16:58 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:58 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" returned: 0 in 0.343s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:58 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36 Nov 05 12:16:58 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:58 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" returned: 0 in 0.245s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-quobyte-d1809b05-1cb3-41e8-9320-f9a3ebc91d36" released by "delete_volume" :: held 0.642s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Created reservations ['23083458-38d9-42bd-8cb3-98a00ab74430', 'b53cdae4-08de-4a2f-a63a-78ffdb12f30e', 'a2e53ada-9667-4807-b051-15d5dbd31655', 'a491b45c-a022-49e8-ad98-f95f941db2e7'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:16:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:16:58 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:16:58 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:16:59 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 05 12:16:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.234s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:16:59 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:16:59 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Deleted volume successfully. Nov 05 12:16:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-2c0dd6d6-a8e3-4e94-8ca5-953984c4f88d tempest-CreateVolumesFromSnapshotTest-1270449352 None] Lock "cinder-d1809b05-1cb3-41e8-9320-f9a3ebc91d36-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Flow 'volume_create_manager' (4fc6ff67-0a57-4051-abd4-ef27b93ac277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c0146d-2e05-4e40-a85e-90a63f3c046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c0146d-2e05-4e40-a85e-90a63f3c046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1012633116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e1a91e-0314-49f9-b060-66019950397d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0480f1cc4486c8ab3856bfb7c1af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:02Z,use_quota=True,user_id='a43e468292494c38a95c66d90a37203c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41dedae-bbd2-4ffc-bfb1-fc087fccd0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41dedae-bbd2-4ffc-bfb1-fc087fccd0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eaa5a4-f18d-4611-be4b-0a42b1524539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eaa5a4-f18d-4611-be4b-0a42b1524539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e1a91e-0314-49f9-b060-66019950397d', 'volume_name': 'volume-35e1a91e-0314-49f9-b060-66019950397d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a07978-715b-4e02-b709-6c7041c5d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a07978-715b-4e02-b709-6c7041c5d288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b778e1-852a-4900-8f5c-e81d7b94972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:01 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Volume 35e1a91e-0314-49f9-b060-66019950397d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e1a91e-0314-49f9-b060-66019950397d', 'volume_size': 1} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1012633116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e1a91e-0314-49f9-b060-66019950397d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0480f1cc4486c8ab3856bfb7c1af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:02Z,use_quota=True,user_id='a43e468292494c38a95c66d90a37203c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Creating volume 35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:01 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:01 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d 1073741824 Nov 05 12:17:01 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:02 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d 1073741824" returned: 0 in 0.419s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:02 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d Nov 05 12:17:02 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:02 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d" returned: 0 in 0.248s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b778e1-852a-4900-8f5c-e81d7b94972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e1a91e-0314-49f9-b060-66019950397d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04e847e-d56c-44e1-97e8-4acb1ba148af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:02 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Volume volume-35e1a91e-0314-49f9-b060-66019950397d (35e1a91e-0314-49f9-b060-66019950397d): created successfully Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04e847e-d56c-44e1-97e8-4acb1ba148af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Flow 'volume_create_manager' (4fc6ff67-0a57-4051-abd4-ef27b93ac277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f2c804d0-d623-444b-a7c2-262c55e09e1c tempest-VolumeDependencyTests-1272141224 None] Created volume successfully. Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Creating offline snapshot c0ab5927-9392-4eec-be89-e444b2996b5d of volume 35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17233e-5732-444f-a06c-5e386ea14bfb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:03 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d Nov 05 12:17:03 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:03 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d" returned: 0 in 0.343s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:03 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d 1G Nov 05 12:17:03 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:03 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d 1G" returned: 0 in 0.389s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e1a91e-0314-49f9-b060-66019950397d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:03 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e1a91e-0314-49f9-b060-66019950397d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d Nov 05 12:17:03 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:04 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e1a91e-0314-49f9-b060-66019950397d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d" returned: 0 in 0.296s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:04 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d is being set with open permissions: ugo+rw Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:04 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d Nov 05 12:17:04 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:04 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d" returned: 0 in 0.235s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:04 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.info Nov 05 12:17:04 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:04 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.info" returned: 0 in 0.237s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:04 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.info is being set with open permissions: ugo+rw Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:04 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.info Nov 05 12:17:04 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:04 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.info" returned: 0 in 0.252s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1f255091-ad19-4e4a-af4f-0ec4d70d3955 tempest-VolumeDependencyTests-1272141224 None] Create snapshot completed successfully Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Flow 'volume_create_manager' (1ad02bf8-f349-44e9-b9da-75d3d5eff7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903b1666-4356-48e7-a641-eb49e211ff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903b1666-4356-48e7-a641-eb49e211ff48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1196985549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e5c465-683f-4cbe-839b-b579448972d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f0480f1cc4486c8ab3856bfb7c1af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0ab5927-9392-4eec-be89-e444b2996b5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:05Z,use_quota=True,user_id='a43e468292494c38a95c66d90a37203c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59dfb62-d7c6-4daf-9bcc-17968aac215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59dfb62-d7c6-4daf-9bcc-17968aac215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef8d5e1-bb12-40a5-a056-857ca91a0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef8d5e1-bb12-40a5-a056-857ca91a0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3e5c465-683f-4cbe-839b-b579448972d0', 'volume_name': 'volume-c3e5c465-683f-4cbe-839b-b579448972d0', 'volume_size': 1, 'snapshot_id': 'c0ab5927-9392-4eec-be89-e444b2996b5d'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4816e9-c84e-4aab-b1a8-4a7a0069bc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4816e9-c84e-4aab-b1a8-4a7a0069bc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63fd7ba-39ef-4caf-b9c2-30af35667c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Volume c3e5c465-683f-4cbe-839b-b579448972d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3e5c465-683f-4cbe-839b-b579448972d0', 'volume_size': 1, 'snapshot_id': 'c0ab5927-9392-4eec-be89-e444b2996b5d'} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-quobyte-c0ab5927-9392-4eec-be89-e444b2996b5d-c3e5c465-683f-4cbe-839b-b579448972d0" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c0ab5927-9392-4eec-be89-e444b2996b5d-c3e5c465-683f-4cbe-839b-b579448972d0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Creating volume c3e5c465-683f-4cbe-839b-b579448972d0 from snapshot c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-quobyte-c3e5c465-683f-4cbe-839b-b579448972d0" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c3e5c465-683f-4cbe-839b-b579448972d0" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] snapshot: c0ab5927-9392-4eec-be89-e444b2996b5d, volume: c3e5c465-683f-4cbe-839b-b579448972d0, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff06f58-77d3-4d66-a409-a5f7fff9c4c7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:05 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d Nov 05 12:17:05 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:06 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d" returned: 0 in 0.368s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35e1a91e-0314-49f9-b060-66019950397d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a355f8a-ae2b-4c96-b714-ca3767d70390]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:06 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d Nov 05 12:17:06 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:06 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d" returned: 0 in 0.386s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:17:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:06 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 Nov 05 12:17:06 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:12 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0" returned: 0 in 5.815s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:17:12 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Converted 1024.00 MB image at 176.07 MB/s Nov 05 12:17:12 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 is being set with open permissions: ugo+rw Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:12 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 Nov 05 12:17:12 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:12 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c3e5c465-683f-4cbe-839b-b579448972d0" released by "_copy_volume_from_snapshot" :: held 6.888s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c0ab5927-9392-4eec-be89-e444b2996b5d-c3e5c465-683f-4cbe-839b-b579448972d0" released by "_create_volume_from_snapshot" :: held 6.947s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.962s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63fd7ba-39ef-4caf-b9c2-30af35667c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e5c465-683f-4cbe-839b-b579448972d0', 'volume_size': 1, 'snapshot_id': 'c0ab5927-9392-4eec-be89-e444b2996b5d'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d01936-cd7a-42a2-b2d8-daf66c49d96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:12 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Volume volume-c3e5c465-683f-4cbe-839b-b579448972d0 (c3e5c465-683f-4cbe-839b-b579448972d0): created successfully Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d01936-cd7a-42a2-b2d8-daf66c49d96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Flow 'volume_create_manager' (1ad02bf8-f349-44e9-b9da-75d3d5eff7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:12 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f74a3938-7fe4-4fe3-9264-6b93a53d7505 tempest-VolumeDependencyTests-1272141224 None] Created volume successfully. Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-c0ab5927-9392-4eec-be89-e444b2996b5d-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-c0ab5927-9392-4eec-be89-e444b2996b5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-quobyte-35e1a91e-0314-49f9-b060-66019950397d" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-35e1a91e-0314-49f9-b060-66019950397d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-quobyte-c0ab5927-9392-4eec-be89-e444b2996b5d" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c0ab5927-9392-4eec-be89-e444b2996b5d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Deleting offline snapshot c0ab5927-9392-4eec-be89-e444b2996b5d of volume 35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] snapshot_file for this snap is: volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[097c9c84-eca8-46f7-b90b-754526638ace]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:13 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d Nov 05 12:17:13 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:13 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d" returned: 0 in 0.344s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35e1a91e-0314-49f9-b060-66019950397d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74647d5-7bd3-44fe-b77d-365f44cb0641]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:13 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d Nov 05 12:17:13 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:14 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d" returned: 0 in 0.519s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:14 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d Nov 05 12:17:14 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:14 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d" returned: 0 in 0.324s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:14 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d Nov 05 12:17:14 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:14 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d.c0ab5927-9392-4eec-be89-e444b2996b5d" returned: 0 in 0.240s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c0ab5927-9392-4eec-be89-e444b2996b5d" released by "_delete_snapshot" :: held 1.526s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-35e1a91e-0314-49f9-b060-66019950397d" released by "delete_snapshot" :: held 1.548s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Created reservations ['b192975c-9fb1-4c2f-afc2-e2e513c2ebc8', '23b6345a-827e-4c4b-a71a-fdb0cf5b1835', '06843e4b-7b3e-4692-af06-b6ebcf2e2906', '5417c625-7513-42b3-86ab-d75c8ee40266'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Delete snapshot completed successfully. Nov 05 12:17:14 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b416583b-488d-4cb8-911c-da794ef94202 tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-c0ab5927-9392-4eec-be89-e444b2996b5d-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-35e1a91e-0314-49f9-b060-66019950397d-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-35e1a91e-0314-49f9-b060-66019950397d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-quobyte-35e1a91e-0314-49f9-b060-66019950397d" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-35e1a91e-0314-49f9-b060-66019950397d" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[92081e5b-df1d-42a4-a053-2acc1d8f7fcb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:15 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d Nov 05 12:17:15 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:15 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d" returned: 0 in 0.358s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:15 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d Nov 05 12:17:15 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:15 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-35e1a91e-0314-49f9-b060-66019950397d" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-35e1a91e-0314-49f9-b060-66019950397d" released by "delete_volume" :: held 0.665s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:15 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Created reservations ['a06304f5-f2c9-4538-9ad1-575bf6a7abe7', '08e7ab03-acbf-4460-96a7-e3075cbc6c1e', '155bfc1d-90f0-426b-83d3-780f455c1064', '8cfc2201-1c4f-4c00-bba0-5ffc2645ca43'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:16 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:16 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:16 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.233s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Deleted volume successfully. Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3b385c7e-b81d-4036-ab8e-7da4a6822a4b tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-35e1a91e-0314-49f9-b060-66019950397d-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-c3e5c465-683f-4cbe-839b-b579448972d0-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-c3e5c465-683f-4cbe-839b-b579448972d0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "cinder-quobyte-c3e5c465-683f-4cbe-839b-b579448972d0" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c3e5c465-683f-4cbe-839b-b579448972d0" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[892a633b-b11c-4a3c-9c49-4873dcf5c3bb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:16 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 Nov 05 12:17:16 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:16 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0" returned: 0 in 0.353s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:16 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0 Nov 05 12:17:16 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:17 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c3e5c465-683f-4cbe-839b-b579448972d0" returned: 0 in 0.245s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-quobyte-c3e5c465-683f-4cbe-839b-b579448972d0" released by "delete_volume" :: held 0.640s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Created reservations ['f4c39f4d-2731-42a1-9229-a36bd413212a', '2f1db19e-4a0f-46e0-a1aa-69cae79f0d24', '84abf5ba-6e13-4a29-a966-e0dd62aa78d0', 'c1460fca-e939-4ef6-9763-f0305fba323c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:17 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:17 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:17 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.232s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Deleted volume successfully. Nov 05 12:17:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-89bd55fa-efe4-4c7b-a55b-b0941f33dfcd tempest-VolumeDependencyTests-1272141224 None] Lock "cinder-c3e5c465-683f-4cbe-839b-b579448972d0-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Flow 'volume_create_manager' (be35696a-8595-419a-ac54-c3c37090399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e140628-1edc-4020-936d-cedf0d59e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e140628-1edc-4020-936d-cedf0d59e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf886467-69ff-434c-bbe6-a49f6b219fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb556f11ccc4c95a72a8d72b0285d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:20Z,use_quota=True,user_id='99bbf0790b5e4c20978cd06a4acf686c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e802b958-5fdb-4420-a064-da61898aede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e802b958-5fdb-4420-a064-da61898aede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e8bd49-92ab-4e5f-9bab-3b594590b55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e8bd49-92ab-4e5f-9bab-3b594590b55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf886467-69ff-434c-bbe6-a49f6b219fd6', 'volume_name': 'volume-cf886467-69ff-434c-bbe6-a49f6b219fd6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374ec3e2-c96a-4398-b7a4-def499c4aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374ec3e2-c96a-4398-b7a4-def499c4aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941a9655-983b-4d4c-835a-200e4eeef74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:20 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Volume cf886467-69ff-434c-bbe6-a49f6b219fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf886467-69ff-434c-bbe6-a49f6b219fd6', 'volume_size': 1} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf886467-69ff-434c-bbe6-a49f6b219fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb556f11ccc4c95a72a8d72b0285d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:20Z,use_quota=True,user_id='99bbf0790b5e4c20978cd06a4acf686c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Creating volume cf886467-69ff-434c-bbe6-a49f6b219fd6 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:20 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:20 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 1073741824 Nov 05 12:17:20 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:20 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 1073741824" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:20 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 Nov 05 12:17:20 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:21 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6" returned: 0 in 0.249s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941a9655-983b-4d4c-835a-200e4eeef74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf886467-69ff-434c-bbe6-a49f6b219fd6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb010cf-f4b7-4e62-883f-8a494b41259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Volume volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 (cf886467-69ff-434c-bbe6-a49f6b219fd6): created successfully Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb010cf-f4b7-4e62-883f-8a494b41259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Flow 'volume_create_manager' (be35696a-8595-419a-ac54-c3c37090399f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:21 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-024160b5-4a2d-4f09-b383-c4efe5250e73 tempest-CinderUnicodeTest-934301648 None] Created volume successfully. Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Flow 'volume_create_manager' (0d0214c7-9459-41aa-8829-f8eeea20d100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b670f12-48fe-4014-ade0-41ad672dc449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b670f12-48fe-4014-ade0-41ad672dc449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1841046571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8de95b1-2019-4960-9f84-70a2621fdeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb556f11ccc4c95a72a8d72b0285d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:22Z,use_quota=True,user_id='99bbf0790b5e4c20978cd06a4acf686c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303f773a-e851-4489-9192-50caa788e04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303f773a-e851-4489-9192-50caa788e04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f536adb8-77cf-4fb3-aef9-7845ddb96640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f536adb8-77cf-4fb3-aef9-7845ddb96640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8de95b1-2019-4960-9f84-70a2621fdeef', 'volume_name': 'volume-b8de95b1-2019-4960-9f84-70a2621fdeef', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56be891f-b84e-458a-b0bf-b71674772e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56be891f-b84e-458a-b0bf-b71674772e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b00bf3-a6ff-4421-9140-2fefecb74b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Volume b8de95b1-2019-4960-9f84-70a2621fdeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8de95b1-2019-4960-9f84-70a2621fdeef', 'volume_size': 1} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1841046571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8de95b1-2019-4960-9f84-70a2621fdeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb556f11ccc4c95a72a8d72b0285d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:22Z,use_quota=True,user_id='99bbf0790b5e4c20978cd06a4acf686c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Creating volume b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:21 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:21 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef 1073741824 Nov 05 12:17:21 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:22 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef 1073741824" returned: 0 in 0.401s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:22 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef Nov 05 12:17:22 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:22 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef" returned: 0 in 0.237s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b00bf3-a6ff-4421-9140-2fefecb74b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8de95b1-2019-4960-9f84-70a2621fdeef', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f984e29-5187-44f3-92d5-a732750cc64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:22 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Volume volume-b8de95b1-2019-4960-9f84-70a2621fdeef (b8de95b1-2019-4960-9f84-70a2621fdeef): created successfully Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f984e29-5187-44f3-92d5-a732750cc64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Flow 'volume_create_manager' (0d0214c7-9459-41aa-8829-f8eeea20d100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e9efc3a5-d199-4586-bc06-d23e17e23c7d tempest-CinderUnicodeTest-934301648 None] Created volume successfully. Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Creating offline snapshot 4472c71d-827f-431a-8b45-77580f1d6961 of volume b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d26d3a7-4d7b-4110-ba5d-c5929f74c1a4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:23 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef Nov 05 12:17:23 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:23 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:23 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 1G Nov 05 12:17:23 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:23 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 1G" returned: 0 in 0.388s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8de95b1-2019-4960-9f84-70a2621fdeef -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:23 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8de95b1-2019-4960-9f84-70a2621fdeef -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 Nov 05 12:17:23 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:24 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8de95b1-2019-4960-9f84-70a2621fdeef -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961" returned: 0 in 0.284s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:24 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 is being set with open permissions: ugo+rw Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:24 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 Nov 05 12:17:24 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:24 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:24 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.info Nov 05 12:17:24 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:24 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.info" returned: 0 in 0.245s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:24 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.info is being set with open permissions: ugo+rw Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:24 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.info Nov 05 12:17:24 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:24 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.info" returned: 0 in 0.247s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9309f258-0da5-49ee-9b3d-4700c29bb628 tempest-CinderUnicodeTest-934301648 None] Create snapshot completed successfully Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "cinder-4472c71d-827f-431a-8b45-77580f1d6961-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-4472c71d-827f-431a-8b45-77580f1d6961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "cinder-quobyte-b8de95b1-2019-4960-9f84-70a2621fdeef" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-b8de95b1-2019-4960-9f84-70a2621fdeef" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "cinder-quobyte-4472c71d-827f-431a-8b45-77580f1d6961" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-4472c71d-827f-431a-8b45-77580f1d6961" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Deleting offline snapshot 4472c71d-827f-431a-8b45-77580f1d6961 of volume b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] snapshot_file for this snap is: volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b198a9e6-a9e9-4b3f-a8f2-bc53e3771da2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:25 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 Nov 05 12:17:25 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:25 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961" returned: 0 in 0.368s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8de95b1-2019-4960-9f84-70a2621fdeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea427c2f-0fc3-44a8-a0ea-39e6bac94bd7]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:25 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef Nov 05 12:17:25 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:25 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef" returned: 0 in 0.376s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:26 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 Nov 05 12:17:26 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:26 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961" returned: 0 in 0.332s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:26 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961 Nov 05 12:17:26 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:26 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef.4472c71d-827f-431a-8b45-77580f1d6961" returned: 0 in 0.256s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=112,cinder:UPDATE=168,cinder:DELETE=14,cinder:INSERT=39 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-4472c71d-827f-431a-8b45-77580f1d6961" released by "_delete_snapshot" :: held 1.437s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-b8de95b1-2019-4960-9f84-70a2621fdeef" released by "delete_snapshot" :: held 1.460s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Created reservations ['c29117be-bf4f-4cf4-b5ba-3651dd411bc8', '4c1b3212-e4ba-4816-bd13-a73e97c2bc50', '5d388209-1fe3-46ae-bac0-ad317dd438d4', 'dd435f9b-d91c-45be-aa55-6a99d6467f4d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Delete snapshot completed successfully. Nov 05 12:17:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-9384f333-801a-4d39-93e7-870f46310fa2 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-4472c71d-827f-431a-8b45-77580f1d6961-delete_snapshot" released by "delete_snapshot" :: held 1.585s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "cinder-b8de95b1-2019-4960-9f84-70a2621fdeef-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-b8de95b1-2019-4960-9f84-70a2621fdeef-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=167,cinder:SELECT=132,cinder:INSERT=40,cinder:DELETE=17 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "cinder-quobyte-b8de95b1-2019-4960-9f84-70a2621fdeef" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-b8de95b1-2019-4960-9f84-70a2621fdeef" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e270b72-cb91-497b-9529-e79663dcc076]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:27 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef Nov 05 12:17:27 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:27 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef" returned: 0 in 0.376s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:27 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef Nov 05 12:17:27 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:28 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b8de95b1-2019-4960-9f84-70a2621fdeef" returned: 0 in 0.256s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-b8de95b1-2019-4960-9f84-70a2621fdeef" released by "delete_volume" :: held 0.694s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Created reservations ['4d030b97-6edc-4db6-acc1-5af4e087d559', '42f5a4d1-6bad-4482-84de-c259653ea2cd', 'c9203c9a-293a-44bb-a953-8b71097e7e51', '89024793-a385-4655-b7eb-5f964e9091e6'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:28 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:28 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:28 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.249s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:28 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Deleted volume successfully. Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c92aaa7b-6020-4cd7-b343-56c5f6f3fd82 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-b8de95b1-2019-4960-9f84-70a2621fdeef-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "cinder-cf886467-69ff-434c-bbe6-a49f6b219fd6-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-cf886467-69ff-434c-bbe6-a49f6b219fd6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "cinder-quobyte-cf886467-69ff-434c-bbe6-a49f6b219fd6" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-cf886467-69ff-434c-bbe6-a49f6b219fd6" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[506cbe97-8ec1-4231-a6f1-1a96f0de3b06]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:28 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 Nov 05 12:17:28 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:28 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6" returned: 0 in 0.368s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:28 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6 Nov 05 12:17:28 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:29 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-cf886467-69ff-434c-bbe6-a49f6b219fd6" returned: 0 in 0.240s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-quobyte-cf886467-69ff-434c-bbe6-a49f6b219fd6" released by "delete_volume" :: held 0.650s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Created reservations ['762b1f19-adf4-41ad-8945-459394bdfcb1', '4770a533-d506-4c79-a0d2-a06d3e2f0616', 'd971bc1f-0fd7-44b1-b89e-be39c24aeb5b', '60a6daaa-604c-4ff6-9026-9bbf73084c27'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:29 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:29 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:29 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Deleted volume successfully. Nov 05 12:17:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa597532-8438-495b-82e4-41e760cfaf00 tempest-CinderUnicodeTest-934301648 None] Lock "cinder-cf886467-69ff-434c-bbe6-a49f6b219fd6-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:39 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=24 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:17:39 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Flow 'volume_create_manager' (e917fdc3-7e9a-4658-a44f-676f4cfbda5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc30c3c2-7532-4c28-991f-ef3bac6fc77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc30c3c2-7532-4c28-991f-ef3bac6fc77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2106398041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059695d7-bdfd-455e-b2ae-6c402708bf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890e2f6c05e54131ac2857d5901ae392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:41Z,use_quota=True,user_id='1abfea78d5aa43498f7961614fad0714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0851f34-5d69-4515-9850-6df8772a17f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0851f34-5d69-4515-9850-6df8772a17f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02acbec4-258c-4bf2-81de-a1dfdce26037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02acbec4-258c-4bf2-81de-a1dfdce26037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059695d7-bdfd-455e-b2ae-6c402708bf81', 'volume_name': 'volume-059695d7-bdfd-455e-b2ae-6c402708bf81', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4fb253-6403-46fd-99fc-fe7e4755d0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4fb253-6403-46fd-99fc-fe7e4755d0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1a7e29-5be3-4a55-be5c-8d5bbda8b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Volume 059695d7-bdfd-455e-b2ae-6c402708bf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059695d7-bdfd-455e-b2ae-6c402708bf81', 'volume_size': 1} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2106398041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059695d7-bdfd-455e-b2ae-6c402708bf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890e2f6c05e54131ac2857d5901ae392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:41Z,use_quota=True,user_id='1abfea78d5aa43498f7961614fad0714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Creating volume 059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:41 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:41 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 1073741824 Nov 05 12:17:41 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (fc15e346-9fa3-4c88-8912-34e826c816b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909b6c67-cd69-47aa-9f44-4ce8d29a9405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909b6c67-cd69-47aa-9f44-4ce8d29a9405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-43863579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9425bc52-c802-4fa9-bded-f7e107bc755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda6832d-1611-4428-9b7d-5dfd1f1deb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda6832d-1611-4428-9b7d-5dfd1f1deb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3833dde6-e590-4a90-8998-ce41b154dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3833dde6-e590-4a90-8998-ce41b154dd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9425bc52-c802-4fa9-bded-f7e107bc755c', 'volume_name': 'volume-9425bc52-c802-4fa9-bded-f7e107bc755c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cda325-2ee7-431a-9a95-9471d92c8f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cda325-2ee7-431a-9a95-9471d92c8f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e29c7ab-4391-4590-8aa3-d5a804be6c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Volume 9425bc52-c802-4fa9-bded-f7e107bc755c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9425bc52-c802-4fa9-bded-f7e107bc755c', 'volume_size': 1} Nov 05 12:17:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (93e505f2-e8cf-4e3f-8cec-28d7110a91bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56189a27-03b2-40ca-a50c-9f5c1113f127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56189a27-03b2-40ca-a50c-9f5c1113f127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436894303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91459dc-7fc5-444d-a418-8d99ed0cbab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86037587-a53a-46fb-9358-f6d11b1eaf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86037587-a53a-46fb-9358-f6d11b1eaf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d81297-681f-4799-98b6-763a7f1372e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d81297-681f-4799-98b6-763a7f1372e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91459dc-7fc5-444d-a418-8d99ed0cbab6', 'volume_name': 'volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e16bb21-4353-44cb-a031-e03f06c8d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e16bb21-4353-44cb-a031-e03f06c8d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413f3c20-7988-4dcb-8792-2f09dc00a045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Volume c91459dc-7fc5-444d-a418-8d99ed0cbab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6', 'volume_size': 1} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (ee71493c-d830-4546-871e-b46662a3f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcebec9e-0077-46b5-bae5-783a4f26d80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 1073741824" returned: 0 in 0.696s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcebec9e-0077-46b5-bae5-783a4f26d80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167816918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba3997b-6c23-47bb-a53e-e877f5592e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b33277-d119-48c9-bb00-8859cd81fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b33277-d119-48c9-bb00-8859cd81fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93541fd9-300e-48f9-b005-c3c1c878b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93541fd9-300e-48f9-b005-c3c1c878b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba3997b-6c23-47bb-a53e-e877f5592e01', 'volume_name': 'volume-9ba3997b-6c23-47bb-a53e-e877f5592e01', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8270fb4-5818-43f3-b276-f1c02e92f7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8270fb4-5818-43f3-b276-f1c02e92f7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f050e7b-c381-4c23-9247-5c5df81bcc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume 9ba3997b-6c23-47bb-a53e-e877f5592e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba3997b-6c23-47bb-a53e-e877f5592e01', 'volume_size': 1} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:42 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 Nov 05 12:17:42 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (28d6b14c-c78e-4ca2-b183-b1a9ed2c6e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79631fee-511b-4c67-b78e-8fc4676fc4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79631fee-511b-4c67-b78e-8fc4676fc4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329071920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2161fc54-3315-4ba2-9243-c96efba6051c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b928293-d897-40f6-b122-026ab66d3496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b928293-d897-40f6-b122-026ab66d3496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8215aa98-4e62-4754-b212-a53c9afe1285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8215aa98-4e62-4754-b212-a53c9afe1285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2161fc54-3315-4ba2-9243-c96efba6051c', 'volume_name': 'volume-2161fc54-3315-4ba2-9243-c96efba6051c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7c8f1c-1d20-49d9-9b3f-d037b07f9077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7c8f1c-1d20-49d9-9b3f-d037b07f9077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1696d913-fc6d-4829-bdb2-2da9cd009868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Volume 2161fc54-3315-4ba2-9243-c96efba6051c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2161fc54-3315-4ba2-9243-c96efba6051c', 'volume_size': 1} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:42 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81" returned: 0 in 0.307s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-43863579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9425bc52-c802-4fa9-bded-f7e107bc755c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Creating volume 9425bc52-c802-4fa9-bded-f7e107bc755c {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:42 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:42 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c 1073741824 Nov 05 12:17:42 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1a7e29-5be3-4a55-be5c-8d5bbda8b75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059695d7-bdfd-455e-b2ae-6c402708bf81', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8374b9-b034-447b-9ac6-d391c571ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Volume volume-059695d7-bdfd-455e-b2ae-6c402708bf81 (059695d7-bdfd-455e-b2ae-6c402708bf81): created successfully Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8374b9-b034-447b-9ac6-d391c571ea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Flow 'volume_create_manager' (e917fdc3-7e9a-4658-a44f-676f4cfbda5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-de8ff3e5-5357-4052-bfaf-dbf6e9e113a5 tempest-VolumeDependencyTests-185243441 None] Created volume successfully. Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (2109df64-ce65-4447-a6c9-dfa6cb460202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536d8748-ed27-44cd-879b-c1d39cf6dc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536d8748-ed27-44cd-879b-c1d39cf6dc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566429190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0f974-bd9d-443c-b22b-4572b6819da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:43Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ba3709-70e0-4f36-b998-26ddde70b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ba3709-70e0-4f36-b998-26ddde70b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f891106d-ced3-4d1b-9c02-d72cf5da49e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f891106d-ced3-4d1b-9c02-d72cf5da49e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb0f974-bd9d-443c-b22b-4572b6819da2', 'volume_name': 'volume-3fb0f974-bd9d-443c-b22b-4572b6819da2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa99a85-fe93-4b63-874e-38afb03c2848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa99a85-fe93-4b63-874e-38afb03c2848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7548c011-e599-4060-9775-83906d318ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Volume 3fb0f974-bd9d-443c-b22b-4572b6819da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb0f974-bd9d-443c-b22b-4572b6819da2', 'volume_size': 1} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:43 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c 1073741824" returned: 0 in 0.578s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:43 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c Nov 05 12:17:43 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (23db6039-5681-4c17-9627-2d1af4db9f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efddfc1a-a271-4d1e-8ff4-99aa665f3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efddfc1a-a271-4d1e-8ff4-99aa665f3b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654154599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603867ab-ad80-4200-86c4-a8a5d9b117d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:43Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ff83b-d32a-48e0-9677-e234f78f6388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ff83b-d32a-48e0-9677-e234f78f6388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74b6ad4-65dd-4eb6-aec1-7f4ca04fe72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74b6ad4-65dd-4eb6-aec1-7f4ca04fe72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '603867ab-ad80-4200-86c4-a8a5d9b117d7', 'volume_name': 'volume-603867ab-ad80-4200-86c4-a8a5d9b117d7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d3ed7c-a01e-4d4e-bc4a-ce91f88f0516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d3ed7c-a01e-4d4e-bc4a-ce91f88f0516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff777c1-f0c7-48f1-83d8-94e00e096e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Volume 603867ab-ad80-4200-86c4-a8a5d9b117d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-603867ab-ad80-4200-86c4-a8a5d9b117d7', 'volume_size': 1} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:43 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c" returned: 0 in 0.310s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436894303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91459dc-7fc5-444d-a418-8d99ed0cbab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Creating volume c91459dc-7fc5-444d-a418-8d99ed0cbab6 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:43 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e29c7ab-4391-4590-8aa3-d5a804be6c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9425bc52-c802-4fa9-bded-f7e107bc755c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 1073741824 Nov 05 12:17:43 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3b4fa3-4b06-4ea6-b838-150701b54a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:43 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Volume volume-9425bc52-c802-4fa9-bded-f7e107bc755c (9425bc52-c802-4fa9-bded-f7e107bc755c): created successfully Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3b4fa3-4b06-4ea6-b838-150701b54a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (fc15e346-9fa3-4c88-8912-34e826c816b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5592416d-5f91-4dc0-a3eb-b3aa9a2ba4c1 tempest-CreateVolumesFromImageTest-119814156 None] Created volume successfully. Nov 05 12:17:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:44 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 1073741824" returned: 0 in 0.521s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:44 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 Nov 05 12:17:44 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:44 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6" returned: 0 in 0.251s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.110s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167816918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba3997b-6c23-47bb-a53e-e877f5592e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Creating volume 9ba3997b-6c23-47bb-a53e-e877f5592e01 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:44 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:44 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 1073741824 Nov 05 12:17:44 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413f3c20-7988-4dcb-8792-2f09dc00a045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b1f961-4fa6-40eb-a668-fbcb24b43486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:44 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Volume volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 (c91459dc-7fc5-444d-a418-8d99ed0cbab6): created successfully Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b1f961-4fa6-40eb-a668-fbcb24b43486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (93e505f2-e8cf-4e3f-8cec-28d7110a91bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:44 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-af2c9aed-904f-4b7e-9940-0543afac9e5d tempest-CreateVolumesFromImageTest-119814156 None] Created volume successfully. Nov 05 12:17:44 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 1073741824" returned: 0 in 0.454s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:45 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 Nov 05 12:17:45 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:45 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01" returned: 0 in 0.257s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.654s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329071920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2161fc54-3315-4ba2-9243-c96efba6051c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:42Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Creating volume 2161fc54-3315-4ba2-9243-c96efba6051c {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:45 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f050e7b-c381-4c23-9247-5c5df81bcc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba3997b-6c23-47bb-a53e-e877f5592e01', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:45 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c 1073741824 Nov 05 12:17:45 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e07dc6-f6ef-4bb9-8662-44cc7e22fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:45 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 (9ba3997b-6c23-47bb-a53e-e877f5592e01): created successfully Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e07dc6-f6ef-4bb9-8662-44cc7e22fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (ee71493c-d830-4546-871e-b46662a3f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-05a5cf80-6920-4d71-b995-c916a77b6e71 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created volume successfully. Nov 05 12:17:45 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c 1073741824" returned: 0 in 0.466s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:45 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c Nov 05 12:17:45 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Flow 'volume_create_manager' (35641f40-6bdc-4c4b-a38b-778eed9e8bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88641cee-a6ff-454c-b74b-51fad2bf943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88641cee-a6ff-454c-b74b-51fad2bf943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2a948a34614d9da8cb50f6f3c36639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:46Z,use_quota=True,user_id='8f28ed3a3cae4be598fb103044e15f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9c84567-f5bd-40fa-9fb3-abd260ffaf87),volume_type_id=e9c84567-f5bd-40fa-9fb3-abd260ffaf87)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ca89e2-43d5-4713-a194-ab69abde9523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ca89e2-43d5-4713-a194-ab69abde9523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb01df5-cc83-4b6b-9a59-18014c0796b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:45 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:17:46 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.840s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566429190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0f974-bd9d-443c-b22b-4572b6819da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:43Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Creating volume 3fb0f974-bd9d-443c-b22b-4572b6819da2 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:46 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1696d913-fc6d-4829-bdb2-2da9cd009868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2161fc54-3315-4ba2-9243-c96efba6051c', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:46 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 1073741824 Nov 05 12:17:46 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da11bf7d-1de8-46b2-a0db-7e82abaa18bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Volume volume-2161fc54-3315-4ba2-9243-c96efba6051c (2161fc54-3315-4ba2-9243-c96efba6051c): created successfully Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da11bf7d-1de8-46b2-a0db-7e82abaa18bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (28d6b14c-c78e-4ca2-b183-b1a9ed2c6e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-952a4729-6f79-4836-9913-ceba13988d26 tempest-CreateVolumesFromImageTest-119814156 None] Created volume successfully. Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb01df5-cc83-4b6b-9a59-18014c0796b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3', 'volume_name': 'volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3', 'volume_size': 1, 'image_id': 'e7fda799-74b6-4913-b300-97edab09ac3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7fda799-74b6-4913-b300-97edab09ac3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c20adaeb1e3b95e9c4cb5c39c1a05ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca2a948a34614d9da8cb50f6f3c36639', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bea6f60aade5b5031748721b1bcc9425db7b5f8fb9612adacc7b7e63ac488b212082702c0894234c4f56e62ae061671cf899237481e959f2a9d7524d253e2313', 'id': 'e7fda799-74b6-4913-b300-97edab09ac3a', 'created_at': datetime.datetime(2026, 11, 5, 11, 17, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 17, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7fda799-74b6-4913-b300-97edab09ac3a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d91d904-1591-48d2-aaf3-bd7c48600094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d91d904-1591-48d2-aaf3-bd7c48600094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f184c3-70da-4c2e-b612-a3be49a12d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Volume fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3', 'volume_size': 1, 'image_id': 'e7fda799-74b6-4913-b300-97edab09ac3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7fda799-74b6-4913-b300-97edab09ac3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c20adaeb1e3b95e9c4cb5c39c1a05ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca2a948a34614d9da8cb50f6f3c36639', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bea6f60aade5b5031748721b1bcc9425db7b5f8fb9612adacc7b7e63ac488b212082702c0894234c4f56e62ae061671cf899237481e959f2a9d7524d253e2313', 'id': 'e7fda799-74b6-4913-b300-97edab09ac3a', 'created_at': datetime.datetime(2026, 11, 5, 11, 17, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 17, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7fda799-74b6-4913-b300-97edab09ac3a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Trying to clone fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 from image e7fda799-74b6-4913-b300-97edab09ac3a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7fda799-74b6-4913-b300-97edab09ac3a', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:17:46 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Image download 0.00 MB at 0.00 MB/s Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[30829529-3884-4d0e-b6b3-81761b772535]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:46 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD Nov 05 12:17:46 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:46 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 1073741824" returned: 0 in 0.478s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:46 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 Nov 05 12:17:46 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:46 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:46 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD Nov 05 12:17:46 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:46 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (ca314329-0a7b-4e7b-ad30-2b9b20f736c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a924fa-1094-4e81-bc47-fcaf994cf9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2" returned: 0 in 0.382s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.321s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654154599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603867ab-ad80-4200-86c4-a8a5d9b117d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d790e13497145d9934709b39e1a73a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:43Z,use_quota=True,user_id='4c274026d75e49f8ada22a07e5614548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Creating volume 603867ab-ad80-4200-86c4-a8a5d9b117d7 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:46 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7548c011-e599-4060-9775-83906d318ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb0f974-bd9d-443c-b22b-4572b6819da2', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 1073741824 Nov 05 12:17:47 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6135b4-73f3-410e-b804-7d957ce40489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a924fa-1094-4e81-bc47-fcaf994cf9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449483092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257e5ad5-08e4-4f76-a99d-55f67cf95521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:47Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404657f0-e879-4253-8e4b-e903edea7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404657f0-e879-4253-8e4b-e903edea7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9346a059-59e7-452f-a8ea-e6846bc00048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9346a059-59e7-452f-a8ea-e6846bc00048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '257e5ad5-08e4-4f76-a99d-55f67cf95521', 'volume_name': 'volume-257e5ad5-08e4-4f76-a99d-55f67cf95521', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb5310e-3c95-4030-a7e8-d75f36185d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb5310e-3c95-4030-a7e8-d75f36185d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86dce68-437c-4237-82e5-47158aeb0a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume 257e5ad5-08e4-4f76-a99d-55f67cf95521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-257e5ad5-08e4-4f76-a99d-55f67cf95521', 'volume_size': 1} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Volume volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 (3fb0f974-bd9d-443c-b22b-4572b6819da2): created successfully Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6135b4-73f3-410e-b804-7d957ce40489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (2109df64-ce65-4447-a6c9-dfa6cb460202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2d4f1a64-61ef-46a7-a2bc-e411c4bb58b9 tempest-CreateVolumesFromImageTest-119814156 None] Created volume successfully. Nov 05 12:17:47 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD" returned: 1 in 0.459s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Temporary image e7fda799-74b6-4913-b300-97edab09ac3a is fetched for user 8f28ed3a3cae4be598fb103044e15f1d. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe9802-9fff-4c24-9bb0-a128ebec8511]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:47 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD Nov 05 12:17:47 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (c1b515dd-6be8-47d8-b0df-b013a62d25db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaf73c4-2966-4d6b-8847-0e305c05502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaf73c4-2966-4d6b-8847-0e305c05502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097094912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdf9abf-7471-4f50-b753-9893c3ac0cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:47Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcc0f13-7bb5-45cd-a20b-c075d2c42464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbcc0f13-7bb5-45cd-a20b-c075d2c42464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29617e61-d06c-417b-829c-248f60e387c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29617e61-d06c-417b-829c-248f60e387c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cdf9abf-7471-4f50-b753-9893c3ac0cf6', 'volume_name': 'volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1d753c-9977-4a59-803f-3ea1edab8ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1d753c-9977-4a59-803f-3ea1edab8ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e759b8-35d7-4902-a45f-10ef26b60b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume 4cdf9abf-7471-4f50-b753-9893c3ac0cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6', 'volume_size': 1} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:47 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 1073741824" returned: 0 in 0.590s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:47 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:47 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 Nov 05 12:17:47 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:47 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD Nov 05 12:17:47 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (4608cf28-b10f-4a23-817b-540d84451587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd84ffb-aba0-4344-8c0b-66e044133874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd84ffb-aba0-4344-8c0b-66e044133874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536743993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9478227-bf57-4365-9923-af50b527d144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:48Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783a4a9-a84c-40ae-84c7-53387399e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783a4a9-a84c-40ae-84c7-53387399e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc77794-187c-4af7-866d-c34165beee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc77794-187c-4af7-866d-c34165beee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9478227-bf57-4365-9923-af50b527d144', 'volume_name': 'volume-a9478227-bf57-4365-9923-af50b527d144', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee56bf5-f0d9-44c2-a1c1-52caf38248db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee56bf5-f0d9-44c2-a1c1-52caf38248db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6889b48-1deb-487d-b7a4-4beb724fc00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume a9478227-bf57-4365-9923-af50b527d144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9478227-bf57-4365-9923-af50b527d144', 'volume_size': 1} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:48 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7" returned: 0 in 0.445s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.211s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Creating offline snapshot f73a2188-db2f-45e8-a50b-9e594b2118bb of volume 059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff777c1-f0c7-48f1-83d8-94e00e096e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603867ab-ad80-4200-86c4-a8a5d9b117d7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f3e7ac-97fa-4bc2-bf0b-8020b388831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9edad2-c798-48c3-b5b7-5ac84f54e7c4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:48 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD" returned: 1 in 0.505s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Volume volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 (603867ab-ad80-4200-86c4-a8a5d9b117d7): created successfully Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f3e7ac-97fa-4bc2-bf0b-8020b388831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Flow 'volume_create_manager' (23db6039-5681-4c17-9627-2d1af4db9f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-166a1867-45cc-4909-837d-ebb80722904f tempest-CreateVolumesFromImageTest-119814156 None] Created volume successfully. Nov 05 12:17:48 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 Nov 05 12:17:48 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (8490773e-b52f-409b-a746-3ab2c02c2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa72b0c1-e393-4251-8faf-847913f402c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa72b0c1-e393-4251-8faf-847913f402c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140468626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ae58c4-35d4-487b-92bd-2b72da730544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:48Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090e835c-847c-44b7-a6ef-4d451e11224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090e835c-847c-44b7-a6ef-4d451e11224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eead620b-86f0-4182-a4fa-f1e80d626191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eead620b-86f0-4182-a4fa-f1e80d626191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ae58c4-35d4-487b-92bd-2b72da730544', 'volume_name': 'volume-e0ae58c4-35d4-487b-92bd-2b72da730544', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d716171-74ec-47bf-87f8-0857762a83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d716171-74ec-47bf-87f8-0857762a83ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6a2ff5-4724-4aab-9e15-2697fa213e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume e0ae58c4-35d4-487b-92bd-2b72da730544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ae58c4-35d4-487b-92bd-2b72da730544', 'volume_size': 1} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:48 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81" returned: 0 in 0.391s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:48 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb 1G Nov 05 12:17:48 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (17c203cc-9842-4aef-a97a-11df7b88a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d572733-14d0-4f29-8ded-03dcbe813e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d572733-14d0-4f29-8ded-03dcbe813e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050051044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8daf33-d90d-424a-a72c-dcc312f24bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:49Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bbab2a-3d8a-4332-be20-1ecefb0c0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bbab2a-3d8a-4332-be20-1ecefb0c0121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b02ff6-9f21-4270-9cf4-8f711d1e64bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b02ff6-9f21-4270-9cf4-8f711d1e64bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8daf33-d90d-424a-a72c-dcc312f24bf9', 'volume_name': 'volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a57d1f4-0e77-4452-bf46-f0d5032fdb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a57d1f4-0e77-4452-bf46-f0d5032fdb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7a584b-278e-45e6-8782-7733985179e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:48 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume 3d8daf33-d90d-424a-a72c-dcc312f24bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9', 'volume_size': 1} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:48 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb 1G" returned: 0 in 0.407s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059695d7-bdfd-455e-b2ae-6c402708bf81 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:48 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059695d7-bdfd-455e-b2ae-6c402708bf81 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb Nov 05 12:17:48 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-603867ab-ad80-4200-86c4-a8a5d9b117d7-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-603867ab-ad80-4200-86c4-a8a5d9b117d7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:49 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059695d7-bdfd-455e-b2ae-6c402708bf81 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb" returned: 0 in 0.322s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:49 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb is being set with open permissions: ugo+rw Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-quobyte-603867ab-ad80-4200-86c4-a8a5d9b117d7" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:49 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb Nov 05 12:17:49 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-603867ab-ad80-4200-86c4-a8a5d9b117d7" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef2db03-9a8d-4ba0-b930-ec0a5b2e745c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:49 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 Nov 05 12:17:49 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:49 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:49 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.info Nov 05 12:17:49 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:49 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:49 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7 Nov 05 12:17:49 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:49 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.info" returned: 0 in 0.285s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:49 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.info is being set with open permissions: ugo+rw Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:49 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.info Nov 05 12:17:49 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:49 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-603867ab-ad80-4200-86c4-a8a5d9b117d7" returned: 0 in 0.245s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-603867ab-ad80-4200-86c4-a8a5d9b117d7" released by "delete_volume" :: held 0.660s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Created reservations ['189c0be9-0974-4090-8e53-d27cdf94ab49', '6b004263-6166-441d-a07e-5bf9af8ce514', '6eba5d85-d005-4816-81a1-7ddec06b1183', 'de72fd17-7493-4174-b4f0-b506b203a8e6'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:50 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.info" returned: 0 in 0.277s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:50 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:50 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449483092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257e5ad5-08e4-4f76-a99d-55f67cf95521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:47Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Creating volume 257e5ad5-08e4-4f76-a99d-55f67cf95521 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:50 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:50 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 1073741824 Nov 05 12:17:50 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4fd2b150-deb3-43d9-82b0-354129decacb tempest-VolumeDependencyTests-185243441 None] Create snapshot completed successfully Nov 05 12:17:50 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Deleted volume successfully. Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-3fb0f974-bd9d-443c-b22b-4572b6819da2-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-02696bf3-432d-495b-b634-5fb8cbc39158 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-603867ab-ad80-4200-86c4-a8a5d9b117d7-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-3fb0f974-bd9d-443c-b22b-4572b6819da2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-quobyte-3fb0f974-bd9d-443c-b22b-4572b6819da2" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-3fb0f974-bd9d-443c-b22b-4572b6819da2" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05efd5-f93f-470b-986f-b05334ae5563]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:50 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 Nov 05 12:17:50 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:50 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 1073741824" returned: 0 in 0.477s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:50 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 Nov 05 12:17:50 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:50 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2" returned: 0 in 0.391s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:50 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2 Nov 05 12:17:50 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:50 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521" returned: 0 in 0.291s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.449s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097094912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdf9abf-7471-4f50-b753-9893c3ac0cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:47Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Creating volume 4cdf9abf-7471-4f50-b753-9893c3ac0cf6 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:50 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86dce68-437c-4237-82e5-47158aeb0a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-257e5ad5-08e4-4f76-a99d-55f67cf95521', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:50 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 1073741824 Nov 05 12:17:50 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:50 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ed45ad-3396-4880-a422-1c16a8643b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 (257e5ad5-08e4-4f76-a99d-55f67cf95521): created successfully Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ed45ad-3396-4880-a422-1c16a8643b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (ca314329-0a7b-4e7b-ad30-2b9b20f736c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6ac3aa10-2321-4f6f-a6b5-2837ee8a6b10 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created volume successfully. Nov 05 12:17:51 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3fb0f974-bd9d-443c-b22b-4572b6819da2" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-3fb0f974-bd9d-443c-b22b-4572b6819da2" released by "delete_volume" :: held 0.730s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Created reservations ['9dfdcb55-c223-4b3a-8418-e0e5214e7230', 'f66e0b1a-b540-4b89-8c68-8d8ac4de6c82', '8c28808a-3f39-46e8-b220-ca06a8968a56', 'dc92b834-af00-4092-921b-c90403c4645c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:51 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:51 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:51 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 1073741824" returned: 0 in 0.512s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:51 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 Nov 05 12:17:51 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-2161fc54-3315-4ba2-9243-c96efba6051c-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-2161fc54-3315-4ba2-9243-c96efba6051c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-quobyte-2161fc54-3315-4ba2-9243-c96efba6051c" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-2161fc54-3315-4ba2-9243-c96efba6051c" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde2d02-51b2-4325-b5e9-09f355b29daa]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:51 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Deleted volume successfully. Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-68e2184c-0e2b-4b6e-8101-0272f1aa8c87 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-3fb0f974-bd9d-443c-b22b-4572b6819da2-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:51 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c Nov 05 12:17:51 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Flow 'volume_create_manager' (73f24351-2cbe-4223-ad93-5851d49758de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33899303-63cf-4b53-aff9-e77cf3facea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33899303-63cf-4b53-aff9-e77cf3facea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129152924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8164b0-67ba-4cab-89e5-3346501b720a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890e2f6c05e54131ac2857d5901ae392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f73a2188-db2f-45e8-a50b-9e594b2118bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:52Z,use_quota=True,user_id='1abfea78d5aa43498f7961614fad0714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4289fd4-13b3-4a9c-ae4e-3d06402a7d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4289fd4-13b3-4a9c-ae4e-3d06402a7d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8e52e-cee5-45d9-9f41-707a7e796b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8e52e-cee5-45d9-9f41-707a7e796b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d8164b0-67ba-4cab-89e5-3346501b720a', 'volume_name': 'volume-0d8164b0-67ba-4cab-89e5-3346501b720a', 'volume_size': 1, 'snapshot_id': 'f73a2188-db2f-45e8-a50b-9e594b2118bb'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:51 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5456b306-d849-498e-8892-5cbbd2b2d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5456b306-d849-498e-8892-5cbbd2b2d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b24479d-10a4-4d2e-a760-cf9b392b44e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Volume 0d8164b0-67ba-4cab-89e5-3346501b720a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d8164b0-67ba-4cab-89e5-3346501b720a', 'volume_size': 1, 'snapshot_id': 'f73a2188-db2f-45e8-a50b-9e594b2118bb'} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6" returned: 0 in 0.480s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.949s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536743993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9478227-bf57-4365-9923-af50b527d144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:48Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Creating volume a9478227-bf57-4365-9923-af50b527d144 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:52 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e759b8-35d7-4902-a45f-10ef26b60b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:52 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 1073741824 Nov 05 12:17:52 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13243c7-6d8f-403f-960a-b62494b0192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 (4cdf9abf-7471-4f50-b753-9893c3ac0cf6): created successfully Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13243c7-6d8f-403f-960a-b62494b0192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (c1b515dd-6be8-47d8-b0df-b013a62d25db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e08ccddf-a9fe-4617-961c-c12c13b49b97 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created volume successfully. Nov 05 12:17:52 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c" returned: 0 in 0.456s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:52 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c Nov 05 12:17:52 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:52 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-2161fc54-3315-4ba2-9243-c96efba6051c" returned: 0 in 0.290s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-2161fc54-3315-4ba2-9243-c96efba6051c" released by "delete_volume" :: held 0.806s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:52 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 1073741824" returned: 0 in 0.464s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:52 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:52 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Created reservations ['dfc8543d-f944-45c8-9eb2-7de63928281e', 'b4b80efc-a8dd-4341-b3dd-7c4d37009fd8', '99308552-e4c8-420c-93e6-9d8e6694ff7f', '6b12aeb4-6474-4d5c-a85e-04900aac3e32'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:52 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 Nov 05 12:17:52 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:52 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:52 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:52 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.308s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-c91459dc-7fc5-444d-a418-8d99ed0cbab6-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-c91459dc-7fc5-444d-a418-8d99ed0cbab6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:52 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144" returned: 0 in 0.394s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:53 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.787s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2a948a34614d9da8cb50f6f3c36639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:46Z,use_quota=True,user_id='8f28ed3a3cae4be598fb103044e15f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9c84567-f5bd-40fa-9fb3-abd260ffaf87),volume_type_id=e9c84567-f5bd-40fa-9fb3-abd260ffaf87)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Creating volume fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:53 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:53 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 1073741824 Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6889b48-1deb-487d-b7a4-4beb724fc00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9478227-bf57-4365-9923-af50b527d144', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756d544c-b015-4756-91af-a72c420bef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-quobyte-c91459dc-7fc5-444d-a418-8d99ed0cbab6" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.412s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Deleted volume successfully. Nov 05 12:17:53 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume volume-a9478227-bf57-4365-9923-af50b527d144 (a9478227-bf57-4365-9923-af50b527d144): created successfully Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756d544c-b015-4756-91af-a72c420bef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (4608cf28-b10f-4a23-817b-540d84451587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-c91459dc-7fc5-444d-a418-8d99ed0cbab6" acquired by "delete_volume" :: waited 0.053s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:53 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[58654c5f-9f9e-4d40-ab64-b088540f91a2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3698b56a-9a39-4a9a-9d89-1a4dc94692a0 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-2161fc54-3315-4ba2-9243-c96efba6051c-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6f030cda-5c0b-40ed-9a55-b4d6872bde68 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created volume successfully. Nov 05 12:17:53 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 Nov 05 12:17:53 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:53 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 1073741824" returned: 0 in 0.501s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:53 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 Nov 05 12:17:53 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:53 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6" returned: 0 in 0.440s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:53 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6 Nov 05 12:17:53 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:53 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.379s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-140468626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ae58c4-35d4-487b-92bd-2b72da730544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:48Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Creating volume e0ae58c4-35d4-487b-92bd-2b72da730544 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:53 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:53 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 1073741824 Nov 05 12:17:53 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:53 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-c91459dc-7fc5-444d-a418-8d99ed0cbab6" returned: 0 in 0.265s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Attempting download of e7fda799-74b6-4913-b300-97edab09ac3a ((None, [{'url': 'file:///opt/stack/data/glance/images/e7fda799-74b6-4913-b300-97edab09ac3a', 'metadata': {}}])) to volume fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-c91459dc-7fc5-444d-a418-8d99ed0cbab6" released by "delete_volume" :: held 0.772s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcd30a1-c70b-48f2-94a3-e81bb47e8147]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7fda799-74b6-4913-b300-97edab09ac3a_uo2jtn7_ {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:53 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Created reservations ['e1241417-8e6f-402f-b789-72916f420778', 'b06e93bd-3e52-4895-affb-9a419cf5fa67', 'dc08badb-4edb-43e4-9b49-7997ba2e62e5', 'f9657104-2625-49a0-ac77-40cc578f7ec6'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:54 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7fda799-74b6-4913-b300-97edab09ac3a_uo2jtn7_ Nov 05 12:17:54 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:54 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:54 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-9425bc52-c802-4fa9-bded-f7e107bc755c-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-9425bc52-c802-4fa9-bded-f7e107bc755c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "cinder-quobyte-9425bc52-c802-4fa9-bded-f7e107bc755c" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-9425bc52-c802-4fa9-bded-f7e107bc755c" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa26d37-63a4-42d7-8959-5383ce2aa0b9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:54 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 1073741824" returned: 0 in 0.560s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:54 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7fda799-74b6-4913-b300-97edab09ac3a_uo2jtn7_" returned: 0 in 0.462s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7fda799-74b6-4913-b300-97edab09ac3a_uo2jtn7_ {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:54 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.342s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:54 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Deleted volume successfully. Nov 05 12:17:54 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c Nov 05 12:17:54 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-4e3248e6-8392-4f70-b8ae-79730703ce24 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-c91459dc-7fc5-444d-a418-8d99ed0cbab6-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:54 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 Nov 05 12:17:54 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:54 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7fda799-74b6-4913-b300-97edab09ac3a_uo2jtn7_ Nov 05 12:17:54 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:54 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:54 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.937s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050051044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8daf33-d90d-424a-a72c-dcc312f24bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d487b0f7c41d2a0e92230a035d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:49Z,use_quota=True,user_id='2f7eaed765b44290b1813670454122e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Creating volume 3d8daf33-d90d-424a-a72c-dcc312f24bf9 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:54 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c" returned: 0 in 0.427s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:54 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 1073741824 Nov 05 12:17:54 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6a2ff5-4724-4aab-9e15-2697fa213e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ae58c4-35d4-487b-92bd-2b72da730544', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bf20a5-9a28-46ad-974a-930e92b542a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:54 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c Nov 05 12:17:54 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:54 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7fda799-74b6-4913-b300-97edab09ac3a_uo2jtn7_" returned: 1 in 0.381s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7fda799-74b6-4913-b300-97edab09ac3a_uo2jtn7_' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[295698ef-89e1-419b-b332-98f0f42d524c]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:54 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume volume-e0ae58c4-35d4-487b-92bd-2b72da730544 (e0ae58c4-35d4-487b-92bd-2b72da730544): created successfully Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bf20a5-9a28-46ad-974a-930e92b542a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (8490773e-b52f-409b-a746-3ab2c02c2447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:54 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b514286a-0949-4980-957b-677caf62a10d tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created volume successfully. Nov 05 12:17:54 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD Nov 05 12:17:54 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:55 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9425bc52-c802-4fa9-bded-f7e107bc755c" returned: 0 in 0.300s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-quobyte-9425bc52-c802-4fa9-bded-f7e107bc755c" released by "delete_volume" :: held 0.784s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Created reservations ['77eeab07-603c-40bb-82c7-73d35d7ae51a', '75d5b365-14d8-4d26-8ab4-7f8b906ddb33', 'e299041f-ad05-4b7f-b3ff-83a81df2fda0', '93173e50-d767-4ebb-b796-727c227b70ad'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:55 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:55 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 1073741824" returned: 0 in 0.498s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:55 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:55 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:55 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD Nov 05 12:17:55 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:55 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 Nov 05 12:17:55 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:55 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:17:55 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] e7fda799-74b6-4913-b300-97edab09ac3a was raw, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9" returned: 0 in 0.315s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.540s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-quobyte-f73a2188-db2f-45e8-a50b-9e594b2118bb-0d8164b0-67ba-4cab-89e5-3346501b720a" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:55 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.396s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:55 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 Nov 05 12:17:55 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Deleted volume successfully. Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7a584b-278e-45e6-8782-7733985179e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4b6382-45cd-40e6-9c7c-6e2cc3558e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-f73a2188-db2f-45e8-a50b-9e594b2118bb-0d8164b0-67ba-4cab-89e5-3346501b720a" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Creating volume 0d8164b0-67ba-4cab-89e5-3346501b720a from snapshot f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-quobyte-0d8164b0-67ba-4cab-89e5-3346501b720a" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:55 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Volume volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 (3d8daf33-d90d-424a-a72c-dcc312f24bf9): created successfully Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4b6382-45cd-40e6-9c7c-6e2cc3558e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Flow 'volume_create_manager' (17c203cc-9842-4aef-a97a-11df7b88a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-0d8164b0-67ba-4cab-89e5-3346501b720a" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] snapshot: f73a2188-db2f-45e8-a50b-9e594b2118bb, volume: 0d8164b0-67ba-4cab-89e5-3346501b720a, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1807bad0-afdf-4ee9-8e1a-6b35d5c33290 tempest-CreateVolumesFromImageTest-119814156 None] Lock "cinder-9425bc52-c802-4fa9-bded-f7e107bc755c-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1aaf3260-c4cb-4013-aa0c-9bffd88876a1 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created volume successfully. Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c85a76c-e49f-4abf-853f-1203469673bb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:55 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb Nov 05 12:17:55 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:56 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3" returned: 0 in 0.600s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7fda799-74b6-4913-b300-97edab09ac3a_0t42h7dqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:17:56 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:56 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 1G Nov 05 12:17:56 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:56 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb" returned: 0 in 0.439s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059695d7-bdfd-455e-b2ae-6c402708bf81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c563e375-c44d-448b-9ab9-d5b9f5d236d1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:56 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 Nov 05 12:17:56 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:56 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 1G" returned: 0 in 0.397s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Downloaded image e7fda799-74b6-4913-b300-97edab09ac3a ((None, [{'url': 'file:///opt/stack/data/glance/images/e7fda799-74b6-4913-b300-97edab09ac3a', 'metadata': {}}])) to volume fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Temporary image e7fda799-74b6-4913-b300-97edab09ac3a for user 8f28ed3a3cae4be598fb103044e15f1d is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Marking volume fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Copying metadata from image e7fda799-74b6-4913-b300-97edab09ac3a to fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Creating volume glance metadata for volume fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 backed by image e7fda799-74b6-4913-b300-97edab09ac3a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e7fda799-74b6-4913-b300-97edab09ac3a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2c20adaeb1e3b95e9c4cb5c39c1a05ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-3d8daf33-d90d-424a-a72c-dcc312f24bf9-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:56 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f184c3-70da-4c2e-b612-a3be49a12d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3', 'volume_size': 1, 'image_id': 'e7fda799-74b6-4913-b300-97edab09ac3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7fda799-74b6-4913-b300-97edab09ac3a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c20adaeb1e3b95e9c4cb5c39c1a05ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca2a948a34614d9da8cb50f6f3c36639', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bea6f60aade5b5031748721b1bcc9425db7b5f8fb9612adacc7b7e63ac488b212082702c0894234c4f56e62ae061671cf899237481e959f2a9d7524d253e2313', 'id': 'e7fda799-74b6-4913-b300-97edab09ac3a', 'created_at': datetime.datetime(2026, 11, 5, 11, 17, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 17, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7fda799-74b6-4913-b300-97edab09ac3a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac60d4b9-5666-4292-ae7f-313641be2901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81" returned: 0 in 0.489s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-3d8daf33-d90d-424a-a72c-dcc312f24bf9-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:56 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a Nov 05 12:17:56 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:56 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Volume volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 (fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3): created successfully Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac60d4b9-5666-4292-ae7f-313641be2901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Flow 'volume_create_manager' (35641f40-6bdc-4c4b-a38b-778eed9e8bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:17:56 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8eed38a0-ad09-453c-8438-ee14efd17dd9 tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Created volume successfully. Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-quobyte-3d8daf33-d90d-424a-a72c-dcc312f24bf9" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-3d8daf33-d90d-424a-a72c-dcc312f24bf9" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b6c3d-baeb-4c19-bcad-f4553e0905f0]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:56 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 Nov 05 12:17:56 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:57 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9" returned: 0 in 0.437s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:57 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9 Nov 05 12:17:57 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:57 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3d8daf33-d90d-424a-a72c-dcc312f24bf9" returned: 0 in 0.484s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-3d8daf33-d90d-424a-a72c-dcc312f24bf9" released by "delete_volume" :: held 1.017s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Acquiring lock "cinder-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "cinder-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Acquiring lock "cinder-quobyte-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "cinder-quobyte-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3" acquired by "delete_volume" :: waited 0.069s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created reservations ['9f48bd81-8cc9-43cf-aa10-de5fc4ee756a', '2411d7e6-72fd-41bf-9c83-a32b0855083a', 'eb37107a-74b5-4457-9a5f-01ada67d466c', 'fd39f261-fe62-4e07-a9d7-fd3f66409183'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[40927eab-ad02-44ff-9e2a-b076199daea9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:58 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 Nov 05 12:17:58 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:58 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:17:58 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:58 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3" returned: 0 in 0.802s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:58 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.637s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:58 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:17:59 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3 Nov 05 12:17:59 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:59 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Deleted volume successfully. Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-6c9b4a07-30bb-4bc0-8a3a-ce0fca8ee56c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-3d8daf33-d90d-424a-a72c-dcc312f24bf9-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-e0ae58c4-35d4-487b-92bd-2b72da730544-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-e0ae58c4-35d4-487b-92bd-2b72da730544-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-quobyte-e0ae58c4-35d4-487b-92bd-2b72da730544" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-e0ae58c4-35d4-487b-92bd-2b72da730544" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed55d74d-06d4-47bd-bc38-bb8b7b26b10a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:59 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 Nov 05 12:17:59 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3" returned: 0 in 0.568s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:17:59 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "cinder-quobyte-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3" released by "delete_volume" :: held 1.489s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Created reservations ['d948ae41-7d84-4239-933b-21d6ec50d882', '42de5ded-3172-4286-9805-015f9c2dec13', '33a742ef-c92f-4d6b-b693-903fb55fbe14', '31eb7dcc-5612-45dc-8f52-54b611d9385c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:17:59 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 05 12:17:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544" returned: 0 in 0.640s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:00 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:00 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:00 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544 Nov 05 12:18:00 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (f99c7eed-a788-49a6-af2b-0b294f62f2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9428147c-4b2b-4934-92f2-8ecd15c1c52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9428147c-4b2b-4934-92f2-8ecd15c1c52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1054754377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bde831-eed2-4756-ba4e-4ec50d2c3eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:00Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bad084c-9ef3-4674-9c4d-cd1d0464e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bad084c-9ef3-4674-9c4d-cd1d0464e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e1ec81-dfe7-4807-b66b-f01209cc7f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e1ec81-dfe7-4807-b66b-f01209cc7f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24bde831-eed2-4756-ba4e-4ec50d2c3eb5', 'volume_name': 'volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cff65ca-beb2-4a5b-a495-eae1aa675dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cff65ca-beb2-4a5b-a495-eae1aa675dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f808904d-6771-4c0f-96db-ed8d574cf5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:00 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume 24bde831-eed2-4756-ba4e-4ec50d2c3eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5', 'volume_size': 1} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:00 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.545s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:00 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Deleted volume successfully. Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e0ae58c4-35d4-487b-92bd-2b72da730544" returned: 0 in 0.491s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-e0ae58c4-35d4-487b-92bd-2b72da730544" released by "delete_volume" :: held 1.253s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-37119e94-6e6e-45c8-a2b9-8c88b224396f tempest-VolumeAndVolumeTypeFromImageTest-1132923251 None] Lock "cinder-fe3605e5-c7bf-4a38-9aa1-0eba99d28ce3-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created reservations ['c4d95ae3-57d1-4e6d-bb11-f22ed107f745', 'b1ee1d8c-a422-492a-b09e-78222b640c02', '17b3764d-d622-4c42-be42-7479cbe86adf', 'd7d05fe7-ceb1-496e-992d-048604971500'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:00 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:00 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:01 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.357s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:01 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Deleted volume successfully. Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ec31ff0c-654a-46a5-8283-c7b3f4400072 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-e0ae58c4-35d4-487b-92bd-2b72da730544-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-a9478227-bf57-4365-9923-af50b527d144-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-a9478227-bf57-4365-9923-af50b527d144-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-quobyte-a9478227-bf57-4365-9923-af50b527d144" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-a9478227-bf57-4365-9923-af50b527d144" acquired by "delete_volume" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e2cf3d-2976-4767-930a-66a3de33108b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:02 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 Nov 05 12:18:02 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:02 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144" returned: 0 in 0.668s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:02 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144 Nov 05 12:18:02 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:03 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-a9478227-bf57-4365-9923-af50b527d144" returned: 0 in 0.555s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-a9478227-bf57-4365-9923-af50b527d144" released by "delete_volume" :: held 1.324s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created reservations ['5a1223fe-4956-4563-b168-301b62354130', 'e855be63-e5a5-4de4-8041-76b00a658c76', 'aa9e9e7f-833c-4f9c-a1e5-a71901a2fa99', '8cca1d3d-e27d-43d6-aa93-87bd5cb1013d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:03 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:03 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:03 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.411s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:03 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Deleted volume successfully. Nov 05 12:18:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ea7a7767-8898-4848-9464-c91bbee1dab2 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-a9478227-bf57-4365-9923-af50b527d144-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-4cdf9abf-7471-4f50-b753-9893c3ac0cf6-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-4cdf9abf-7471-4f50-b753-9893c3ac0cf6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-quobyte-4cdf9abf-7471-4f50-b753-9893c3ac0cf6" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-4cdf9abf-7471-4f50-b753-9893c3ac0cf6" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd2e34-2a43-4e78-9964-d53e8dc4d3bd]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:04 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 Nov 05 12:18:04 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:05 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6" returned: 0 in 0.743s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:05 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6 Nov 05 12:18:05 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:05 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a" returned: 0 in 8.779s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:18:05 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Converted 1024.00 MB image at 116.63 MB/s Nov 05 12:18:05 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a is being set with open permissions: ugo+rw Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:05 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-4cdf9abf-7471-4f50-b753-9893c3ac0cf6" returned: 0 in 0.315s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:05 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-4cdf9abf-7471-4f50-b753-9893c3ac0cf6" released by "delete_volume" :: held 1.137s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:05 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created reservations ['2439e532-934d-4143-8152-f867b2b1a2fe', '93a347ef-9548-4330-81bf-f6505a43c6b7', 'e47a27c1-6162-421e-bf75-c7e65297d706', '3bcfa7b8-a5a6-41e1-aa83-94167e4986b7'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:05 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:05 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:05 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-0d8164b0-67ba-4cab-89e5-3346501b720a" released by "_copy_volume_from_snapshot" :: held 10.129s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-f73a2188-db2f-45e8-a50b-9e594b2118bb-0d8164b0-67ba-4cab-89e5-3346501b720a" released by "_create_volume_from_snapshot" :: held 10.230s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.284s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.437s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1054754377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bde831-eed2-4756-ba4e-4ec50d2c3eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:00Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Creating volume 24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:05 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:05 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 1073741824 Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b24479d-10a4-4d2e-a760-cf9b392b44e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8164b0-67ba-4cab-89e5-3346501b720a', 'volume_size': 1, 'snapshot_id': 'f73a2188-db2f-45e8-a50b-9e594b2118bb'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:05 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e30a0c8-5bda-494e-ac87-ac2c53cb6ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Volume volume-0d8164b0-67ba-4cab-89e5-3346501b720a (0d8164b0-67ba-4cab-89e5-3346501b720a): created successfully Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e30a0c8-5bda-494e-ac87-ac2c53cb6ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Flow 'volume_create_manager' (73f24351-2cbe-4223-ad93-5851d49758de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:05 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.270s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:05 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b146fd96-8f52-4a99-ab44-3b2717b9b7c8 tempest-VolumeDependencyTests-185243441 None] Created volume successfully. Nov 05 12:18:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Deleted volume successfully. Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b23b987f-307e-41ed-9f45-20510dc4f9d5 tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-4cdf9abf-7471-4f50-b753-9893c3ac0cf6-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:06 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 1073741824" returned: 0 in 0.480s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-f73a2188-db2f-45e8-a50b-9e594b2118bb-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-f73a2188-db2f-45e8-a50b-9e594b2118bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-quobyte-059695d7-bdfd-455e-b2ae-6c402708bf81" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:06 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 Nov 05 12:18:06 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-059695d7-bdfd-455e-b2ae-6c402708bf81" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-quobyte-f73a2188-db2f-45e8-a50b-9e594b2118bb" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-f73a2188-db2f-45e8-a50b-9e594b2118bb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Deleting offline snapshot f73a2188-db2f-45e8-a50b-9e594b2118bb of volume 059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] snapshot_file for this snap is: volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[55500df9-d57a-41f0-818d-41d4ae6ea5e9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-257e5ad5-08e4-4f76-a99d-55f67cf95521-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-257e5ad5-08e4-4f76-a99d-55f67cf95521-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-quobyte-257e5ad5-08e4-4f76-a99d-55f67cf95521" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:06 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb Nov 05 12:18:06 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-257e5ad5-08e4-4f76-a99d-55f67cf95521" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc610298-9cfc-4f14-bd53-71e1a2ff9cb9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:06 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f808904d-6771-4c0f-96db-ed8d574cf5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8118bdd7-a6a6-40f1-bf7c-1c77fc019c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:06 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 (24bde831-eed2-4756-ba4e-4ec50d2c3eb5): created successfully Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8118bdd7-a6a6-40f1-bf7c-1c77fc019c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (f99c7eed-a788-49a6-af2b-0b294f62f2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0a1a2caa-2d19-411e-bb9a-cac5ae6612f4 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created volume successfully. Nov 05 12:18:06 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 Nov 05 12:18:06 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:06 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb" returned: 0 in 0.481s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059695d7-bdfd-455e-b2ae-6c402708bf81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ffcbd0-2ca7-4afd-ad1c-221cc9cad7fb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:07 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 Nov 05 12:18:07 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:07 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521" returned: 0 in 0.428s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:07 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521 Nov 05 12:18:07 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:07 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-257e5ad5-08e4-4f76-a99d-55f67cf95521" returned: 0 in 0.263s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-257e5ad5-08e4-4f76-a99d-55f67cf95521" released by "delete_volume" :: held 0.751s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created reservations ['884b4197-ad18-4df1-be7b-90fe5b450a6b', '67c19070-4b1a-40f8-909a-e2fab53dbb88', '3bbe9411-fcd9-48bf-a984-cd0dddc64c0e', '032d5567-960b-4147-8eb5-7a7550c529c2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:07 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81" returned: 0 in 0.599s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:07 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:07 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:07 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb Nov 05 12:18:07 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-9ba3997b-6c23-47bb-a53e-e877f5592e01-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-9ba3997b-6c23-47bb-a53e-e877f5592e01-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "cinder-quobyte-9ba3997b-6c23-47bb-a53e-e877f5592e01" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-9ba3997b-6c23-47bb-a53e-e877f5592e01" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbaf17b-c132-4510-8ebb-b0d5e9ad5061]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Creating offline snapshot 62b819c6-7b4f-45a3-9134-1f927d09ac88 of volume 24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:18:08 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.437s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[12919edc-12eb-47d0-b781-62a95cb026f1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Deleted volume successfully. Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ee6d1849-6621-4ef0-b33b-ed82e0871c3f tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-257e5ad5-08e4-4f76-a99d-55f67cf95521-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:08 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 Nov 05 12:18:08 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:08 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 Nov 05 12:18:08 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:08 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb" returned: 0 in 0.581s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:08 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb Nov 05 12:18:08 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:08 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01" returned: 0 in 0.476s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:08 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:08 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01 Nov 05 12:18:08 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" returned: 0 in 0.455s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:08 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:08 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 1G Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81.f73a2188-db2f-45e8-a50b-9e594b2118bb" returned: 0 in 0.328s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:08 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-f73a2188-db2f-45e8-a50b-9e594b2118bb" released by "_delete_snapshot" :: held 2.144s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-059695d7-bdfd-455e-b2ae-6c402708bf81" released by "delete_snapshot" :: held 2.164s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Created reservations ['dec4c91c-d8df-4b3c-b715-78514be2d20f', '34c897c6-bd91-4099-8fc0-5e8f45ca16f3', 'dc4db18a-414a-430f-bbe9-9ac9bc1c60db', 'eab1e60b-5a44-4a5b-a151-a7640e7dd477'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Delete snapshot completed successfully. Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e8eb1263-11bd-4b0b-ba8c-cce2985a9265 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-f73a2188-db2f-45e8-a50b-9e594b2118bb-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:08 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-9ba3997b-6c23-47bb-a53e-e877f5592e01" returned: 0 in 0.309s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-quobyte-9ba3997b-6c23-47bb-a53e-e877f5592e01" released by "delete_volume" :: held 0.854s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Created reservations ['4617ff3b-8484-4a1a-8e4b-47cf00b8fd52', '47bb51de-ac03-4f64-bd49-c50cabc93191', 'de2dd7c6-65c5-44ef-a236-4eab0faf5da1', '0703a571-f290-4ec0-8999-43306dea6f05'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:08 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:08 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:09 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 1G" returned: 0 in 0.569s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:09 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 Nov 05 12:18:09 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:09 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.312s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Deleted volume successfully. Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c20a7def-5fca-4d2d-9309-563b52b2786c tempest-CreateVolumesFromSourceVolumeTest-722836497 None] Lock "cinder-9ba3997b-6c23-47bb-a53e-e877f5592e01-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:09 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88" returned: 0 in 0.369s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:09 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 is being set with open permissions: ugo+rw Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:09 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 Nov 05 12:18:09 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-059695d7-bdfd-455e-b2ae-6c402708bf81-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Lock "cinder-059695d7-bdfd-455e-b2ae-6c402708bf81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-quobyte-059695d7-bdfd-455e-b2ae-6c402708bf81" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-059695d7-bdfd-455e-b2ae-6c402708bf81" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:09 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88" returned: 0 in 0.359s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[08631f05-ed93-4be7-a000-a6161c8d4b13]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:09 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.info Nov 05 12:18:09 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:09 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 Nov 05 12:18:09 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:10 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.info" returned: 0 in 0.322s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:10 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.info is being set with open permissions: ugo+rw Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:10 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.info Nov 05 12:18:10 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:10 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81" returned: 0 in 0.465s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:10 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81 Nov 05 12:18:10 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:10 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.info" returned: 0 in 0.316s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-01f862fd-3fc9-47e7-8502-227920bd54cb tempest-CreateVolumesFromSnapshotTest-1772516338 None] Create snapshot completed successfully Nov 05 12:18:10 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-059695d7-bdfd-455e-b2ae-6c402708bf81" returned: 0 in 0.348s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-059695d7-bdfd-455e-b2ae-6c402708bf81" released by "delete_volume" :: held 0.915s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Created reservations ['692403de-cc6c-4ded-8294-0721403be6ad', '53873edb-4819-4d50-ad21-266763313359', '87f8e180-512d-417d-8af4-76889396b13c', '68cc5797-78b8-44ea-a38c-f15470a2efec'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-0d8164b0-67ba-4cab-89e5-3346501b720a-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:10 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:10 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-0d8164b0-67ba-4cab-89e5-3346501b720a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "cinder-quobyte-0d8164b0-67ba-4cab-89e5-3346501b720a" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-0d8164b0-67ba-4cab-89e5-3346501b720a" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[55500cc5-73b4-4c49-9bfb-0401acf234fa]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:11 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.359s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:11 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a Nov 05 12:18:11 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:11 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Deleted volume successfully. Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Flow 'volume_create_manager' (42e38a4e-b83a-4271-b61d-f627a857bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ce38e5-80a8-4278-919f-c323813749cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ce38e5-80a8-4278-919f-c323813749cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3048c5-7f53-40bd-b103-aa576664d9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bc8e2af4ee4ab786b7a17b61357c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:11Z,use_quota=True,user_id='0247ec39e4694442906926e2a87ee291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4137bf4-3745-43c0-b8c8-2b2bbd06b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4137bf4-3745-43c0-b8c8-2b2bbd06b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b342a188-dfcd-4981-9964-6480156539ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.image.glance [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Creating Keystone auth plugin from conf {{(pid=86942) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-fd195420-6ccf-47c5-85f0-c946e290056b tempest-VolumeDependencyTests-185243441 None] Lock "cinder-059695d7-bdfd-455e-b2ae-6c402708bf81-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:11 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a" returned: 0 in 0.465s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:11 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a Nov 05 12:18:11 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (9098b1a4-f040-439c-997d-58744691e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b53b2f1-7244-4bdb-a08e-11761a725067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b53b2f1-7244-4bdb-a08e-11761a725067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169902039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84155074-a1e9-414e-9beb-1e1055ef9d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:12Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e874f4-0f6d-4914-a6db-bd833ed23a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e874f4-0f6d-4914-a6db-bd833ed23a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a9a05c-9ef4-4d17-89c0-2942239e0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a9a05c-9ef4-4d17-89c0-2942239e0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84155074-a1e9-414e-9beb-1e1055ef9d69', 'volume_name': 'volume-84155074-a1e9-414e-9beb-1e1055ef9d69', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5cf895-2a22-412e-8286-00e557af4b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5cf895-2a22-412e-8286-00e557af4b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d586cf39-a033-4259-90de-e3c9fffd828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:11 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume 84155074-a1e9-414e-9beb-1e1055ef9d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84155074-a1e9-414e-9beb-1e1055ef9d69', 'volume_size': 1} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169902039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84155074-a1e9-414e-9beb-1e1055ef9d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:12Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Creating volume 84155074-a1e9-414e-9beb-1e1055ef9d69 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:12 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:12 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0d8164b0-67ba-4cab-89e5-3346501b720a" returned: 0 in 0.482s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:12 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 1073741824 Nov 05 12:18:12 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b342a188-dfcd-4981-9964-6480156539ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f3048c5-7f53-40bd-b103-aa576664d9d6', 'volume_name': 'volume-3f3048c5-7f53-40bd-b103-aa576664d9d6', 'volume_size': 1, 'image_id': 'd0b90a32-43a7-4706-8d14-0075dc2c1877', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0b90a32-43a7-4706-8d14-0075dc2c1877', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1435b56f7f335eb6e662d47bfdd9e544', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74bc8e2af4ee4ab786b7a17b61357c00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17087da3d80268f9597b4462857178dd424f4e84c590c0a151730a600ce13dc04590165b8a81a0121a75e633f58c69b0e3486d40f7fa9d4915bbace6a45b88ac', 'id': 'd0b90a32-43a7-4706-8d14-0075dc2c1877', 'created_at': datetime.datetime(2026, 11, 5, 11, 18, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 18, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0b90a32-43a7-4706-8d14-0075dc2c1877/file', 'properties': {}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc5f7a7-f666-4e30-b2b2-68e5f74118fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc5f7a7-f666-4e30-b2b2-68e5f74118fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d3f676-7d26-4f2b-8955-ef3bed6a3a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:12 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Volume 3f3048c5-7f53-40bd-b103-aa576664d9d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f3048c5-7f53-40bd-b103-aa576664d9d6', 'volume_size': 1, 'image_id': 'd0b90a32-43a7-4706-8d14-0075dc2c1877', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0b90a32-43a7-4706-8d14-0075dc2c1877', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1435b56f7f335eb6e662d47bfdd9e544', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74bc8e2af4ee4ab786b7a17b61357c00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17087da3d80268f9597b4462857178dd424f4e84c590c0a151730a600ce13dc04590165b8a81a0121a75e633f58c69b0e3486d40f7fa9d4915bbace6a45b88ac', 'id': 'd0b90a32-43a7-4706-8d14-0075dc2c1877', 'created_at': datetime.datetime(2026, 11, 5, 11, 18, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 18, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0b90a32-43a7-4706-8d14-0075dc2c1877/file', 'properties': {}}, 'image_service': } Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Trying to clone 3f3048c5-7f53-40bd-b103-aa576664d9d6 from image d0b90a32-43a7-4706-8d14-0075dc2c1877 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0b90a32-43a7-4706-8d14-0075dc2c1877', 'metadata': {}}]). {{(pid=86942) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-quobyte-0d8164b0-67ba-4cab-89e5-3346501b720a" released by "delete_volume" :: held 1.092s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Created reservations ['f681c3be-011e-4801-8de6-af18f8bf9164', 'e2b1c07a-eb00-4829-907b-2ac0bacdbf65', '09615e63-3094-4e3a-9536-92c7cfe8dd18', 'd59e763d-00e3-4472-99f2-eb0ff0a09347'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 12:18:12 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Image download 0.00 MB at 0.00 MB/s Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3776aff-c81f-4f3f-bffb-031ae9bd619e]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:12 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:12 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (76103d54-ece3-4f68-8b11-d6a9e72d67a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:12 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD Nov 05 12:18:12 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a938ae-ada3-4eae-b94f-9cbbcd6b7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a938ae-ada3-4eae-b94f-9cbbcd6b7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080324114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359fdb73-669e-40d5-ab34-62de4e6b47c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:12Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d666af-b2f2-4c60-a7b0-8c3afeb1ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d666af-b2f2-4c60-a7b0-8c3afeb1ad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6912d08-969e-44c2-8990-a087a76bf68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6912d08-969e-44c2-8990-a087a76bf68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359fdb73-669e-40d5-ab34-62de4e6b47c1', 'volume_name': 'volume-359fdb73-669e-40d5-ab34-62de4e6b47c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb724e24-b37a-4743-b48e-9dea5b064037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:12 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb724e24-b37a-4743-b48e-9dea5b064037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f734340-46ed-4aaa-9d5b-0e8782a90e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:12 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume 359fdb73-669e-40d5-ab34-62de4e6b47c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359fdb73-669e-40d5-ab34-62de4e6b47c1', 'volume_size': 1} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.397s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:12 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:12 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Deleted volume successfully. Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 1073741824" returned: 0 in 0.791s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83d6114b-80d1-4de7-8355-442d1807ab85 tempest-VolumeDependencyTests-185243441 None] Lock "cinder-0d8164b0-67ba-4cab-89e5-3346501b720a-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:12 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 Nov 05 12:18:12 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:12 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (a6d36dbf-12b0-4e15-9409-ba48eb483e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adaddc6-91fd-498b-8b22-c6681643b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adaddc6-91fd-498b-8b22-c6681643b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441778270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b79456-21e6-4680-bce7-2c7a11f11f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:13Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b47880d-32f6-4480-9a87-0a63ced4bdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b47880d-32f6-4480-9a87-0a63ced4bdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20838ec2-22b0-42f4-8f8c-74ba430869d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20838ec2-22b0-42f4-8f8c-74ba430869d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b79456-21e6-4680-bce7-2c7a11f11f4d', 'volume_name': 'volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2ec499-d1ca-411b-bc0a-45d296872d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2ec499-d1ca-411b-bc0a-45d296872d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b126da7c-34ac-4e7b-8102-633b8443a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume e1b79456-21e6-4680-bce7-2c7a11f11f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d', 'volume_size': 1} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:13 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:13 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69" returned: 0 in 0.402s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080324114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359fdb73-669e-40d5-ab34-62de4e6b47c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:12Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Creating volume 359fdb73-669e-40d5-ab34-62de4e6b47c1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:13 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:13 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 1073741824 Nov 05 12:18:13 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d586cf39-a033-4259-90de-e3c9fffd828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84155074-a1e9-414e-9beb-1e1055ef9d69', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133d7686-7e0c-448a-9076-4b8af0d539e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume volume-84155074-a1e9-414e-9beb-1e1055ef9d69 (84155074-a1e9-414e-9beb-1e1055ef9d69): created successfully Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133d7686-7e0c-448a-9076-4b8af0d539e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (9098b1a4-f040-439c-997d-58744691e562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:13 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ead00350-d2f2-4731-82c0-a8ac7c0297d6 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created volume successfully. Nov 05 12:18:13 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD" returned: 1 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Temporary image d0b90a32-43a7-4706-8d14-0075dc2c1877 is fetched for user 0247ec39e4694442906926e2a87ee291. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (fd96962d-d989-4ec0-9172-9bee016ef80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4169672d-0061-45ad-bb59-4bc59322165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce106d01-9c5e-491b-91f1-52979919c6e1]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4169672d-0061-45ad-bb59-4bc59322165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-56066634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:13Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d87abd0-64e6-4bcb-9475-28fdff7f6185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d87abd0-64e6-4bcb-9475-28fdff7f6185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9573a80c-d5f0-4ca1-8f43-dbe5ff96a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9573a80c-d5f0-4ca1-8f43-dbe5ff96a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a', 'volume_name': 'volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0aabfc-34cb-4d0a-9a2a-922f0733c5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0aabfc-34cb-4d0a-9a2a-922f0733c5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5d44c6-b637-41c0-a42d-b7dd4611524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a', 'volume_size': 1} Nov 05 12:18:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:13 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD Nov 05 12:18:13 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 1073741824" returned: 0 in 0.759s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:14 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:14 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:14 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 Nov 05 12:18:14 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:14 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD Nov 05 12:18:14 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (b55f336b-ac8b-40f7-a033-9f8cdb0ec3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f210f236-9545-4407-8da1-3796d2074a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f210f236-9545-4407-8da1-3796d2074a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153183582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a7ccf1-2bed-433b-8b4d-60a1d4e10369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:14Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dedb10c-09df-44ad-944c-8f40cd0d0bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dedb10c-09df-44ad-944c-8f40cd0d0bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e10c765-a719-425d-a3e3-f2ed6caf13f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e10c765-a719-425d-a3e3-f2ed6caf13f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a7ccf1-2bed-433b-8b4d-60a1d4e10369', 'volume_name': 'volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7802cd78-1008-4b32-8b70-c49e524d5746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7802cd78-1008-4b32-8b70-c49e524d5746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87dcf5e-12cf-4590-8093-ba947ee4e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:14 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume 83a7ccf1-2bed-433b-8b4d-60a1d4e10369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369', 'volume_size': 1} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:14 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:14 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1" returned: 0 in 0.404s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441778270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b79456-21e6-4680-bce7-2c7a11f11f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:13Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Creating volume e1b79456-21e6-4680-bce7-2c7a11f11f4d {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:14 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:14 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d 1073741824 Nov 05 12:18:14 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f734340-46ed-4aaa-9d5b-0e8782a90e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359fdb73-669e-40d5-ab34-62de4e6b47c1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fdaf2a-89f0-4964-b11c-16b8cda44fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:14 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 (359fdb73-669e-40d5-ab34-62de4e6b47c1): created successfully Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fdaf2a-89f0-4964-b11c-16b8cda44fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (76103d54-ece3-4f68-8b11-d6a9e72d67a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-94caac5d-834a-4fcb-a4b0-82f3799f8d46 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created volume successfully. Nov 05 12:18:15 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d 1073741824" returned: 0 in 0.562s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:15 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d Nov 05 12:18:15 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:15 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d" returned: 0 in 0.320s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-56066634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:13Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Creating volume ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:15 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:15 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a 1073741824 Nov 05 12:18:15 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b126da7c-34ac-4e7b-8102-633b8443a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44314775-b899-48a9-afb7-cfacf7d7c3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:15 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d (e1b79456-21e6-4680-bce7-2c7a11f11f4d): created successfully Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44314775-b899-48a9-afb7-cfacf7d7c3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:15 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (a6d36dbf-12b0-4e15-9409-ba48eb483e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6efc2b94-226d-45cf-829f-446415bde996 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created volume successfully. Nov 05 12:18:16 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a 1073741824" returned: 0 in 0.607s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:16 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a Nov 05 12:18:16 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:16 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a" returned: 0 in 0.333s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.146s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153183582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a7ccf1-2bed-433b-8b4d-60a1d4e10369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fcc7a0bc341479ca52a1628ba862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:14Z,use_quota=True,user_id='de15226e58f84cef92d3cae587e2e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Creating volume 83a7ccf1-2bed-433b-8b4d-60a1d4e10369 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:16 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:16 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 1073741824 Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5d44c6-b637-41c0-a42d-b7dd4611524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:16 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36212d9a-2d94-4656-87d2-d7c2ea136479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:16 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a (ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a): created successfully Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36212d9a-2d94-4656-87d2-d7c2ea136479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:16 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (fd96962d-d989-4ec0-9172-9bee016ef80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d643e91d-29ca-4a8b-b135-61ee82d2ac8c tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created volume successfully. Nov 05 12:18:17 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 1073741824" returned: 0 in 0.556s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:17 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 Nov 05 12:18:17 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:17 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369" returned: 0 in 0.301s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.913s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3048c5-7f53-40bd-b103-aa576664d9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bc8e2af4ee4ab786b7a17b61357c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:11Z,use_quota=True,user_id='0247ec39e4694442906926e2a87ee291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Creating volume 3f3048c5-7f53-40bd-b103-aa576664d9d6 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:17 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87dcf5e-12cf-4590-8093-ba947ee4e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b919e05-37a7-4580-9e54-0fdd752f100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:17 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 1073741824 Nov 05 12:18:17 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:17 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Volume volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 (83a7ccf1-2bed-433b-8b4d-60a1d4e10369): created successfully Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b919e05-37a7-4580-9e54-0fdd752f100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Flow 'volume_create_manager' (b55f336b-ac8b-40f7-a033-9f8cdb0ec3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-402fb7d5-1107-4bf0-b9b4-11ff449dc2f1 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created volume successfully. Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Flow 'volume_create_manager' (1b9659eb-3766-4cab-abdc-b4318f472336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbef3c18-ca87-4660-8327-16c9f3b00df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbef3c18-ca87-4660-8327-16c9f3b00df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce528132-fb86-4cdf-8696-7fcd8084ce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ff36c3f4034975886a3e4017e5960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:18Z,use_quota=True,user_id='33c5d6fe63aa4cd69190bb669a1639e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b3acaa-7367-4665-98db-67f727907de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b3acaa-7367-4665-98db-67f727907de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b71de28-d129-440f-beb9-bcdb2ff6b81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b71de28-d129-440f-beb9-bcdb2ff6b81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce528132-fb86-4cdf-8696-7fcd8084ce33', 'volume_name': 'volume-ce528132-fb86-4cdf-8696-7fcd8084ce33', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d395b9-9d78-460a-baea-059de3f06510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d395b9-9d78-460a-baea-059de3f06510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ae6d30-3bfc-4403-b724-8989c4aca715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:17 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Volume ce528132-fb86-4cdf-8696-7fcd8084ce33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce528132-fb86-4cdf-8696-7fcd8084ce33', 'volume_size': 1} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-83a7ccf1-2bed-433b-8b4d-60a1d4e10369-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-83a7ccf1-2bed-433b-8b4d-60a1d4e10369-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-83a7ccf1-2bed-433b-8b4d-60a1d4e10369" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-83a7ccf1-2bed-433b-8b4d-60a1d4e10369" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deed533-ca33-4610-bfc2-368df40c1bee]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:17 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 Nov 05 12:18:17 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:18 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 1073741824" returned: 0 in 0.620s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:18 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 Nov 05 12:18:18 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:18 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369" returned: 0 in 0.416s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:18 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369 Nov 05 12:18:18 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:18 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6" returned: 0 in 0.264s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce528132-fb86-4cdf-8696-7fcd8084ce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ff36c3f4034975886a3e4017e5960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:18Z,use_quota=True,user_id='33c5d6fe63aa4cd69190bb669a1639e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Creating volume ce528132-fb86-4cdf-8696-7fcd8084ce33 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:18 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:18 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 1073741824 Nov 05 12:18:18 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Attempting download of d0b90a32-43a7-4706-8d14-0075dc2c1877 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0b90a32-43a7-4706-8d14-0075dc2c1877', 'metadata': {}}])) to volume 3f3048c5-7f53-40bd-b103-aa576664d9d6. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b3cab5-47fa-49d2-9d84-1bc3d12b9dfa]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0b90a32-43a7-4706-8d14-0075dc2c1877_u12rro0c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:18 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-83a7ccf1-2bed-433b-8b4d-60a1d4e10369" returned: 0 in 0.332s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-83a7ccf1-2bed-433b-8b4d-60a1d4e10369" released by "delete_volume" :: held 0.819s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created reservations ['ec0c71d7-db48-41ab-b826-67fcd0389774', '77277d8b-8d72-47f3-a66d-adfe752ff1c8', '90b7640d-b7e2-4694-8aa6-6d38373a4792', '9fb373ff-b97d-4c5a-94c0-cb50ab106168'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:18 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0b90a32-43a7-4706-8d14-0075dc2c1877_u12rro0c Nov 05 12:18:18 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:18 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:18 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:19 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0b90a32-43a7-4706-8d14-0075dc2c1877_u12rro0c" returned: 0 in 0.561s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0b90a32-43a7-4706-8d14-0075dc2c1877_u12rro0c {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b56df6-497e-4b5d-a97d-64683902a94c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:19 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 1073741824" returned: 0 in 0.899s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:19 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0b90a32-43a7-4706-8d14-0075dc2c1877_u12rro0c Nov 05 12:18:19 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:19 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 Nov 05 12:18:19 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:19 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a Nov 05 12:18:19 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:19 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.525s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Deleted volume successfully. Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7036482d-94ff-435f-9971-1c93ed8b4b92 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-83a7ccf1-2bed-433b-8b4d-60a1d4e10369-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:19 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0b90a32-43a7-4706-8d14-0075dc2c1877_u12rro0c" returned: 1 in 0.546s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0b90a32-43a7-4706-8d14-0075dc2c1877_u12rro0c' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e273ac20-4f28-4401-b19d-a789727b70ab]: (4, 'raw') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:19 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33" returned: 0 in 0.329s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ae6d30-3bfc-4403-b724-8989c4aca715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce528132-fb86-4cdf-8696-7fcd8084ce33', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58c28ae-e4b3-4450-abd9-900ed41fa103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:19 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a" returned: 0 in 0.453s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:19 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Volume volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 (ce528132-fb86-4cdf-8696-7fcd8084ce33): created successfully Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58c28ae-e4b3-4450-abd9-900ed41fa103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:19 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a Nov 05 12:18:19 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Flow 'volume_create_manager' (1b9659eb-3766-4cab-abdc-b4318f472336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-affbc013-5a5e-48ce-a396-4216d4e6bd12 tempest-CinderUnicodeTest-1855222564 None] Created volume successfully. Nov 05 12:18:19 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD Nov 05 12:18:19 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:20 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a" returned: 0 in 0.331s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:20 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a" released by "delete_volume" :: held 0.880s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created reservations ['14ccc900-b5e0-4c24-afc1-3bb98235fbef', '00598750-64d3-4496-b78e-271cef343ac3', 'c454a149-e4ff-4cb8-acaf-726864bd4159', '347ed03d-762a-43e5-abef-bb9537700123'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:20 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD Nov 05 12:18:20 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:20 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:20 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-e1b79456-21e6-4680-bce7-2c7a11f11f4d-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-e1b79456-21e6-4680-bce7-2c7a11f11f4d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-e1b79456-21e6-4680-bce7-2c7a11f11f4d" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-e1b79456-21e6-4680-bce7-2c7a11f11f4d" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:20 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] d0b90a32-43a7-4706-8d14-0075dc2c1877 was raw, converting to qcow2 {{(pid=86942) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c46e01-aefd-423b-a8b4-ebc7689c16d2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:20 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 Nov 05 12:18:20 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:20 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.364s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Deleted volume successfully. Nov 05 12:18:20 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d Nov 05 12:18:20 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61199cbb-acc8-40b1-abdb-1d83856c19ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-ea0b65ed-cb49-42d2-b8a3-82ddf0a28a9a-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:20 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d" returned: 0 in 0.517s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:21 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d Nov 05 12:18:21 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:21 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6" returned: 0 in 0.639s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0b90a32-43a7-4706-8d14-0075dc2c1877_xg28mjkfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:18:21 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:21 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 1G Nov 05 12:18:21 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:21 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e1b79456-21e6-4680-bce7-2c7a11f11f4d" returned: 0 in 0.405s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-e1b79456-21e6-4680-bce7-2c7a11f11f4d" released by "delete_volume" :: held 0.988s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Flow 'volume_create_manager' (c23a42da-0678-49fa-8d74-be7f553420d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a643c152-c9b6-4e5a-a7d8-2840cfbc6c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:21 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 1G" returned: 0 in 0.457s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Downloaded image d0b90a32-43a7-4706-8d14-0075dc2c1877 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0b90a32-43a7-4706-8d14-0075dc2c1877', 'metadata': {}}])) to volume 3f3048c5-7f53-40bd-b103-aa576664d9d6 successfully. {{(pid=86942) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Temporary image d0b90a32-43a7-4706-8d14-0075dc2c1877 for user 0247ec39e4694442906926e2a87ee291 is deleted. {{(pid=86942) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.volume_utils [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Marking volume 3f3048c5-7f53-40bd-b103-aa576664d9d6 as bootable. {{(pid=86942) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a643c152-c9b6-4e5a-a7d8-2840cfbc6c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1839534921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8ad60e-a5b4-4358-a17d-6757bccce7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ff36c3f4034975886a3e4017e5960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:21Z,use_quota=True,user_id='33c5d6fe63aa4cd69190bb669a1639e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c40103e-d812-49fa-963f-e20236b90ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c40103e-d812-49fa-963f-e20236b90ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5898c04e-97ae-42ee-aad0-a5b55061ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5898c04e-97ae-42ee-aad0-a5b55061ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8ad60e-a5b4-4358-a17d-6757bccce7a5', 'volume_name': 'volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bef4a2-5eb4-4b30-9e96-e8ff6d9c983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bef4a2-5eb4-4b30-9e96-e8ff6d9c983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158ab867-0b0c-4f4e-a71d-4fa336babd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Volume 5a8ad60e-a5b4-4358-a17d-6757bccce7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5', 'volume_size': 1} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1839534921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8ad60e-a5b4-4358-a17d-6757bccce7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ff36c3f4034975886a3e4017e5960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:21Z,use_quota=True,user_id='33c5d6fe63aa4cd69190bb669a1639e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Creating volume 5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:21 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Copying metadata from image d0b90a32-43a7-4706-8d14-0075dc2c1877 to 3f3048c5-7f53-40bd-b103-aa576664d9d6. {{(pid=86942) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Creating volume glance metadata for volume 3f3048c5-7f53-40bd-b103-aa576664d9d6 backed by image d0b90a32-43a7-4706-8d14-0075dc2c1877 with: {'image_id': 'd0b90a32-43a7-4706-8d14-0075dc2c1877', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1435b56f7f335eb6e662d47bfdd9e544', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86942) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created reservations ['68cd7161-0fa9-411e-942a-05218c10cf77', '9c16228c-6c9a-425f-b756-9042a4e14b4a', '84ff24eb-a86a-4aa6-9b5d-e7c9c4f6c20e', 'dc6d38ae-f936-480d-b340-7835d9445cb3'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:21 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 1073741824 Nov 05 12:18:21 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d3f676-7d26-4f2b-8955-ef3bed6a3a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3048c5-7f53-40bd-b103-aa576664d9d6', 'volume_size': 1, 'image_id': 'd0b90a32-43a7-4706-8d14-0075dc2c1877', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0b90a32-43a7-4706-8d14-0075dc2c1877', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1435b56f7f335eb6e662d47bfdd9e544', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74bc8e2af4ee4ab786b7a17b61357c00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17087da3d80268f9597b4462857178dd424f4e84c590c0a151730a600ce13dc04590165b8a81a0121a75e633f58c69b0e3486d40f7fa9d4915bbace6a45b88ac', 'id': 'd0b90a32-43a7-4706-8d14-0075dc2c1877', 'created_at': datetime.datetime(2026, 11, 5, 11, 18, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 18, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0b90a32-43a7-4706-8d14-0075dc2c1877/file', 'properties': {}}, 'image_service': }' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec11da-8347-49c5-b222-4bc6e82def6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:21 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:21 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:21 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Volume volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 (3f3048c5-7f53-40bd-b103-aa576664d9d6): created successfully Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec11da-8347-49c5-b222-4bc6e82def6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:21 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Flow 'volume_create_manager' (42e38a4e-b83a-4271-b61d-f627a857bc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:21 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-faaede0d-2821-4174-98c8-479c3f2a46e0 tempest-VolumeImageDependencyTests-1825216891 None] Created volume successfully. Nov 05 12:18:22 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.287s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Deleted volume successfully. Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-66b89173-20fb-49d6-90f8-f461714d78ac tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-e1b79456-21e6-4680-bce7-2c7a11f11f4d-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:22 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 1073741824" returned: 0 in 0.537s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:22 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 Nov 05 12:18:22 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Acquiring lock "cinder-3f3048c5-7f53-40bd-b103-aa576664d9d6-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Lock "cinder-3f3048c5-7f53-40bd-b103-aa576664d9d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Acquiring lock "cinder-quobyte-3f3048c5-7f53-40bd-b103-aa576664d9d6" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Lock "cinder-quobyte-3f3048c5-7f53-40bd-b103-aa576664d9d6" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ebf72c-c883-45bd-83f2-e6d2925289e1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:22 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" returned: 0 in 0.291s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158ab867-0b0c-4f4e-a71d-4fa336babd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5285519f-1b87-408d-89d0-321f544ee0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:22 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Volume volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 (5a8ad60e-a5b4-4358-a17d-6757bccce7a5): created successfully Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5285519f-1b87-408d-89d0-321f544ee0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:22 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Flow 'volume_create_manager' (c23a42da-0678-49fa-8d74-be7f553420d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:22 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-213f8db0-808f-4054-8d7e-0e9d3f7f9849 tempest-CinderUnicodeTest-1855222564 None] Created volume successfully. Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-359fdb73-669e-40d5-ab34-62de4e6b47c1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-359fdb73-669e-40d5-ab34-62de4e6b47c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-359fdb73-669e-40d5-ab34-62de4e6b47c1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-359fdb73-669e-40d5-ab34-62de4e6b47c1" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[39833716-35e6-4d07-b214-6816dca9548c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:22 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6" returned: 0 in 0.476s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:22 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 Nov 05 12:18:22 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:22 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6 Nov 05 12:18:22 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:23 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3f3048c5-7f53-40bd-b103-aa576664d9d6" returned: 0 in 0.259s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Lock "cinder-quobyte-3f3048c5-7f53-40bd-b103-aa576664d9d6" released by "delete_volume" :: held 0.797s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:23 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1" returned: 0 in 0.407s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:23 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1 Nov 05 12:18:23 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Created reservations ['f64d6333-e21a-4ef9-9966-d1954d1e582a', '31767a6c-6e01-4616-ae4d-3c340abd9e30', 'a94f37f9-ceac-4e53-9722-13625e104024', 'e3c542a9-3689-4329-b05b-f2b4d8b6403f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:23 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:23 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:23 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-359fdb73-669e-40d5-ab34-62de4e6b47c1" returned: 0 in 0.325s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-359fdb73-669e-40d5-ab34-62de4e6b47c1" released by "delete_volume" :: held 0.813s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created reservations ['5686903e-5784-41c8-a6a0-fdcb8cbc8722', '402a8f9a-4896-43c9-9013-3c08fb7f4cc2', 'a8b3c562-9031-48e4-bb88-3120006bce76', 'a1adceab-d041-49e9-9096-613a3335139d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:23 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.480s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:23 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Deleted volume successfully. Nov 05 12:18:23 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:23 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ebcf7060-5ba5-4d5a-ac8b-d08f9f8952ec tempest-VolumeImageDependencyTests-1825216891 None] Lock "cinder-3f3048c5-7f53-40bd-b103-aa576664d9d6-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-84155074-a1e9-414e-9beb-1e1055ef9d69-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-84155074-a1e9-414e-9beb-1e1055ef9d69-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Creating offline snapshot 41218daa-cefb-4400-b1b3-63219c14bf5f of volume 5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-84155074-a1e9-414e-9beb-1e1055ef9d69" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-84155074-a1e9-414e-9beb-1e1055ef9d69" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a70b6c4-f77c-4d27-90b4-f67faf51f237]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69344d-057e-46f6-adc8-b270492dd3b9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:24 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 Nov 05 12:18:24 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:24 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 Nov 05 12:18:24 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:24 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.736s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Deleted volume successfully. Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5bfe35d2-d2e5-4f10-a9b5-2c613f3d5d50 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-359fdb73-669e-40d5-ab34-62de4e6b47c1-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:24 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" returned: 0 in 0.460s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:24 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f 1G Nov 05 12:18:24 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:24 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69" returned: 0 in 0.537s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:24 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69 Nov 05 12:18:24 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:25 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-84155074-a1e9-414e-9beb-1e1055ef9d69" returned: 0 in 0.342s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-84155074-a1e9-414e-9beb-1e1055ef9d69" released by "delete_volume" :: held 0.981s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created reservations ['ecdf7571-2485-4acb-ac86-6218f1c03d1e', 'd015f27a-38c9-4826-ae22-3c689bb9eff5', '0c086e90-54b7-4939-ab5a-f2489c469b1a', '68d0056f-b860-4ed9-98a0-8e56f8dcd691'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:25 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:25 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:25 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f 1G" returned: 0 in 0.703s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:25 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f Nov 05 12:18:25 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:25 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:25 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Deleted volume successfully. Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-131b1998-5398-4c38-b6b2-391bd00c9351 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-84155074-a1e9-414e-9beb-1e1055ef9d69-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:25 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f" returned: 0 in 0.360s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:25 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f is being set with open permissions: ugo+rw Nov 05 12:18:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:25 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f Nov 05 12:18:25 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:26 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f" returned: 0 in 0.305s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:26 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.info Nov 05 12:18:26 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:26 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.info" returned: 0 in 0.305s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:26 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.info is being set with open permissions: ugo+rw Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:26 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.info Nov 05 12:18:26 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-62b819c6-7b4f-45a3-9134-1f927d09ac88-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-62b819c6-7b4f-45a3-9134-1f927d09ac88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-62b819c6-7b4f-45a3-9134-1f927d09ac88" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-62b819c6-7b4f-45a3-9134-1f927d09ac88" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Deleting offline snapshot 62b819c6-7b4f-45a3-9134-1f927d09ac88 of volume 24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] snapshot_file for this snap is: volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a07cf1-1c7f-4bd6-bfc6-39d3dc115523]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:26 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 Nov 05 12:18:26 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:26 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.info" returned: 0 in 0.321s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ce6b8823-a6dd-432b-bd69-a84fa63ea216 tempest-CinderUnicodeTest-1855222564 None] Create snapshot completed successfully Nov 05 12:18:27 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88" returned: 0 in 0.535s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d9df0-7dbd-4fd6-8317-8ec9908058db]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "cinder-41218daa-cefb-4400-b1b3-63219c14bf5f-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-41218daa-cefb-4400-b1b3-63219c14bf5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "cinder-quobyte-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "cinder-quobyte-41218daa-cefb-4400-b1b3-63219c14bf5f" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:27 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 Nov 05 12:18:27 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-41218daa-cefb-4400-b1b3-63219c14bf5f" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Deleting offline snapshot 41218daa-cefb-4400-b1b3-63219c14bf5f of volume 5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] snapshot_file for this snap is: volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[161c6522-cf85-404f-a53e-cc6bc046a9ec]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:27 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f Nov 05 12:18:27 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:27 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" returned: 0 in 0.559s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:27 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 Nov 05 12:18:27 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:27 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f" returned: 0 in 0.571s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fec8c7-d085-46c5-a710-1735eb283238]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:28 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 Nov 05 12:18:28 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:28 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88" returned: 0 in 0.474s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:28 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88 Nov 05 12:18:28 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:28 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5.62b819c6-7b4f-45a3-9134-1f927d09ac88" returned: 0 in 0.279s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:28 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" returned: 0 in 0.520s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:28 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f Nov 05 12:18:28 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-62b819c6-7b4f-45a3-9134-1f927d09ac88" released by "_delete_snapshot" :: held 2.117s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" released by "delete_snapshot" :: held 2.155s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created reservations ['5699845e-4034-48bb-8688-005087946f73', '11bcd2a2-39a9-4825-af4a-f802163f139b', 'db47dde7-ab1b-4465-b99b-34d850b33422', 'fda4034c-16c9-4e59-ac87-96ba21714b40'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:28 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Delete snapshot completed successfully. Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60920845-3d49-455c-94d9-3dc021efe4ff tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-62b819c6-7b4f-45a3-9134-1f927d09ac88-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (662de1c6-560d-4e2e-8e93-c9f6a0e65415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec740439-6978-4e06-93e7-a56e59b2b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec740439-6978-4e06-93e7-a56e59b2b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13976518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21060667-3417-4ca4-88f3-ef0c4622bf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:29Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7b68e3-ec68-45ac-9482-26a64747e90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7b68e3-ec68-45ac-9482-26a64747e90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9aa7107-fcb9-49a0-a5ae-7235d1165b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9aa7107-fcb9-49a0-a5ae-7235d1165b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21060667-3417-4ca4-88f3-ef0c4622bf77', 'volume_name': 'volume-21060667-3417-4ca4-88f3-ef0c4622bf77', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8b9da5-f429-409a-806b-577f4aab3aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8b9da5-f429-409a-806b-577f4aab3aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:28 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac2f575-204c-4214-8aec-736d459dcaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:29 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Volume 21060667-3417-4ca4-88f3-ef0c4622bf77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21060667-3417-4ca4-88f3-ef0c4622bf77', 'volume_size': 1} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13976518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21060667-3417-4ca4-88f3-ef0c4622bf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:29Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Creating volume 21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:29 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:29 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 1073741824 Nov 05 12:18:29 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:29 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f" returned: 0 in 0.518s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:29 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f Nov 05 12:18:29 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:29 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5.41218daa-cefb-4400-b1b3-63219c14bf5f" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-41218daa-cefb-4400-b1b3-63219c14bf5f" released by "_delete_snapshot" :: held 2.045s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" released by "delete_snapshot" :: held 2.092s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Created reservations ['2e72dbeb-9498-4f9e-98f3-040688e31184', 'e4ff2b11-f182-41cb-9d8d-305b421896d0', 'f749d655-94cd-40f3-b24d-8bb8d00082f3', 'dbd22709-3a40-404d-ae11-c96e9b9d4af9'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Delete snapshot completed successfully. Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-8dea48f1-ea87-4a86-872e-3a2b0f7b9fe4 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-41218daa-cefb-4400-b1b3-63219c14bf5f-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:29 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 1073741824" returned: 0 in 0.574s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:29 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 Nov 05 12:18:29 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-24bde831-eed2-4756-ba4e-4ec50d2c3eb5-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-24bde831-eed2-4756-ba4e-4ec50d2c3eb5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "cinder-quobyte-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" acquired by "delete_volume" :: waited 0.041s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce18f07-28be-4785-a1e2-f555c638778d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:30 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77" returned: 0 in 0.395s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac2f575-204c-4214-8aec-736d459dcaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21060667-3417-4ca4-88f3-ef0c4622bf77', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4383c3b-51a0-4a54-b188-213206cc1171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Volume volume-21060667-3417-4ca4-88f3-ef0c4622bf77 (21060667-3417-4ca4-88f3-ef0c4622bf77): created successfully Nov 05 12:18:30 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 Nov 05 12:18:30 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4383c3b-51a0-4a54-b188-213206cc1171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (662de1c6-560d-4e2e-8e93-c9f6a0e65415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-609cec31-ac79-4692-8ac3-047f3ed81a00 tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:18:30 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" returned: 0 in 0.497s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:30 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5 Nov 05 12:18:30 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "cinder-5a8ad60e-a5b4-4358-a17d-6757bccce7a5-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-5a8ad60e-a5b4-4358-a17d-6757bccce7a5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "cinder-quobyte-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f560276c-9d8c-4bd7-91e0-c53324d4eb27]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:30 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" returned: 0 in 0.301s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-quobyte-24bde831-eed2-4756-ba4e-4ec50d2c3eb5" released by "delete_volume" :: held 0.910s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:30 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 Nov 05 12:18:30 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Created reservations ['cc84df65-22fd-4931-a6c4-241a9c5ebdc6', '9c967ad5-db8f-4051-8da8-1c8fdab90789', 'd307e650-f251-42d5-a091-8be8743bda98', '825e2dc7-62e8-4ec9-92d3-c72cadb805b8'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:30 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:31 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:31 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" returned: 0 in 0.456s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:31 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5 Nov 05 12:18:31 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:31 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.315s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Deleted volume successfully. Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-87e39347-d30d-4116-9e50-4374bdb9a504 tempest-CreateVolumesFromSnapshotTest-1772516338 None] Lock "cinder-24bde831-eed2-4756-ba4e-4ec50d2c3eb5-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:31 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" returned: 0 in 0.320s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-5a8ad60e-a5b4-4358-a17d-6757bccce7a5" released by "delete_volume" :: held 0.870s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Created reservations ['ad5daee1-1de7-45bd-ba80-55a82146f67c', 'cf535ba7-818e-4909-bb17-970c0fd6ce07', 'ae3a3e00-d414-4732-8440-3427fcef4344', 'ceaa382b-22b2-49e3-b80d-ce34175dd6c2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:31 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:31 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot 8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 of volume 21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[808859c1-9752-4d67-acc5-e09e10bea9b1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "cinder-ce528132-fb86-4cdf-8696-7fcd8084ce33-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-ce528132-fb86-4cdf-8696-7fcd8084ce33-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:31 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 Nov 05 12:18:31 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "cinder-quobyte-ce528132-fb86-4cdf-8696-7fcd8084ce33" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-ce528132-fb86-4cdf-8696-7fcd8084ce33" acquired by "delete_volume" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4955d909-54fa-4255-a9b0-704476d1cc1c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:32 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.401s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Deleted volume successfully. Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-61f726d3-41be-4f9f-b9c2-fde2d9bc5ecd tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-5a8ad60e-a5b4-4358-a17d-6757bccce7a5-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:32 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 Nov 05 12:18:32 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:32 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77" returned: 0 in 0.620s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:32 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 1G Nov 05 12:18:32 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:32 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33" returned: 0 in 0.548s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:32 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33 Nov 05 12:18:32 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:32 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ce528132-fb86-4cdf-8696-7fcd8084ce33" returned: 0 in 0.352s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:32 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-quobyte-ce528132-fb86-4cdf-8696-7fcd8084ce33" released by "delete_volume" :: held 0.988s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 1G" returned: 0 in 0.604s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21060667-3417-4ca4-88f3-ef0c4622bf77 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:32 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21060667-3417-4ca4-88f3-ef0c4622bf77 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 Nov 05 12:18:32 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Created reservations ['28078639-bc3c-4fd8-baf2-eed327cf8fb5', '94f051fb-9971-4999-b5ab-5062b16890b3', '9310ac25-7f79-4988-a454-e256d062aec1', 'd654a0e1-7f75-4aa1-b085-320bf02af6c0'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:33 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:33 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:33 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21060667-3417-4ca4-88f3-ef0c4622bf77 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" returned: 0 in 0.361s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:33 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 is being set with open permissions: ugo+rw Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:33 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 Nov 05 12:18:33 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:33 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Deleted volume successfully. Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0b9da16-9901-4839-9118-fb4efdac3e82 tempest-CinderUnicodeTest-1855222564 None] Lock "cinder-ce528132-fb86-4cdf-8696-7fcd8084ce33-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:33 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" returned: 0 in 0.286s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:33 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.info Nov 05 12:18:33 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:33 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.info" returned: 0 in 0.309s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:33 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.info is being set with open permissions: ugo+rw Nov 05 12:18:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:33 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.info Nov 05 12:18:33 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:34 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.info" returned: 0 in 0.296s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1706f5d6-ee88-46d2-aadd-49af54d8155f tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-8631c3a1-9cad-48ef-85df-ed8eddb7e7a0-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-8631c3a1-9cad-48ef-85df-ed8eddb7e7a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-21060667-3417-4ca4-88f3-ef0c4622bf77" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-21060667-3417-4ca4-88f3-ef0c4622bf77" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot 8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 of volume 21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d500b9-3d67-4bdc-819d-79d8673c7544]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:35 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 Nov 05 12:18:35 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:35 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" returned: 0 in 0.519s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21060667-3417-4ca4-88f3-ef0c4622bf77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:18:35 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6448e3d-5cf9-451e-abbd-589ff5ddfcd9]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:35 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 Nov 05 12:18:35 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:36 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77" returned: 0 in 0.522s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:36 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 Nov 05 12:18:36 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:36 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" returned: 0 in 0.423s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:36 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0 Nov 05 12:18:36 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:36 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77.8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" returned: 0 in 0.325s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-8631c3a1-9cad-48ef-85df-ed8eddb7e7a0" released by "_delete_snapshot" :: held 1.979s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-21060667-3417-4ca4-88f3-ef0c4622bf77" released by "delete_snapshot" :: held 2.021s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:37 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Created reservations ['a8c9308f-1dbb-4ec8-9961-01ca607569ef', '3bfdde38-1aa3-4d8d-ab93-605792ba955d', 'e70bff65-51de-4cba-be54-671b1f2d6caf', '1341b3d2-ca87-44d4-a230-d51f99c6dfd2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:18:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-82cfbfbb-a7ca-43a0-93c4-53e0dc911d55 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-8631c3a1-9cad-48ef-85df-ed8eddb7e7a0-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-21060667-3417-4ca4-88f3-ef0c4622bf77-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-21060667-3417-4ca4-88f3-ef0c4622bf77-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-21060667-3417-4ca4-88f3-ef0c4622bf77" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-21060667-3417-4ca4-88f3-ef0c4622bf77" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad014d86-78f0-4f40-9e0d-a2c1d9bfd6c4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:38 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 Nov 05 12:18:38 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:38 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-95e7e1c1-6a4b-448b-93ca-72d47b71553b tempest-ProjectAdminTests-1651606257 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3944854736328, 'free_capacity_gb': 1773.3944854736328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86942) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77" returned: 0 in 0.537s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:38 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77 Nov 05 12:18:38 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:39 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-21060667-3417-4ca4-88f3-ef0c4622bf77" returned: 0 in 0.358s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-21060667-3417-4ca4-88f3-ef0c4622bf77" released by "delete_volume" :: held 0.979s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Created reservations ['d797fe00-30ac-49c4-8098-9a8351e4849f', '1f1c3c9f-509b-4f38-8ef8-030839f55a1d', '67497389-20e0-4e5c-8516-c0405b34954e', '2c281b34-8cb8-4937-9263-e2414eda12f0'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=301,cinder:SELECT=217,cinder:INSERT=87,cinder:DELETE=19 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:39 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:39 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:39 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.319s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:39 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:18:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-83b73dd7-e553-46f8-9371-6a0606afd7e5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-21060667-3417-4ca4-88f3-ef0c4622bf77-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=219,cinder:UPDATE=288,cinder:INSERT=72,cinder:DELETE=32 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (49524acc-7212-4d46-b82b-a4f2d4b7ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0d47db-ec41-407d-9e34-fc1bf09bc6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0d47db-ec41-407d-9e34-fc1bf09bc6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696550348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a37f8f0-b735-4d5d-a614-eb4573bc03e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:41Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01a9064-d621-4729-ab37-5b853c849fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01a9064-d621-4729-ab37-5b853c849fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728697a2-356b-4784-a3f1-7099bef5a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728697a2-356b-4784-a3f1-7099bef5a43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a37f8f0-b735-4d5d-a614-eb4573bc03e1', 'volume_name': 'volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe86336-ffd2-4794-b0d9-86267b38a3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe86336-ffd2-4794-b0d9-86267b38a3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79bdb16-fe46-45fc-a774-1f08f76a4c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:41 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Volume 3a37f8f0-b735-4d5d-a614-eb4573bc03e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1', 'volume_size': 1} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696550348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a37f8f0-b735-4d5d-a614-eb4573bc03e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:41Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Creating volume 3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:41 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:41 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 1073741824 Nov 05 12:18:41 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:41 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 1073741824" returned: 0 in 0.624s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:41 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 Nov 05 12:18:41 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:42 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" returned: 0 in 0.304s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79bdb16-fe46-45fc-a774-1f08f76a4c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550b01d2-c7a1-4619-9be5-2dfe15faaabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:42 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Volume volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 (3a37f8f0-b735-4d5d-a614-eb4573bc03e1): created successfully Nov 05 12:18:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550b01d2-c7a1-4619-9be5-2dfe15faaabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:42 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (49524acc-7212-4d46-b82b-a4f2d4b7ec80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-6bfd26c9-d9f0-430c-ac5b-d2082d25eb28 tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:18:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:43 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot a34bdfcf-c9dd-4e7a-a691-04fc780f8769 of volume 3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:18:43 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e447ba-f17c-4d07-9e4b-4185a10db1c2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:43 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 Nov 05 12:18:43 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:44 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" returned: 0 in 0.627s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:44 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 1G Nov 05 12:18:44 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:44 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 1G" returned: 0 in 0.598s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:44 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 Nov 05 12:18:44 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:44 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769" returned: 0 in 0.357s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:44 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 is being set with open permissions: ugo+rw Nov 05 12:18:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:45 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 Nov 05 12:18:45 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:45 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769" returned: 0 in 0.314s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:45 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.info Nov 05 12:18:45 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:45 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.info" returned: 0 in 0.300s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:45 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.info is being set with open permissions: ugo+rw Nov 05 12:18:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:45 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.info Nov 05 12:18:45 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:45 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.info" returned: 0 in 0.348s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-315e9384-266f-4eca-862b-23e5d3ccab5b tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Flow 'volume_create_manager' (e38e8620-1941-43af-aaa1-f6926da9bc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39507f15-2d36-4cf3-a5f2-d86fb0d67f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39507f15-2d36-4cf3-a5f2-d86fb0d67f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-695588964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30892761-6480-4ba5-bcdf-3714b2d8e99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3253178cb40c4c5299821a177c5329ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:46Z,use_quota=True,user_id='714914117b0e4d76b3c992a5454c8f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b05ebd6-9fbc-4f9f-8eaa-283b7733e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b05ebd6-9fbc-4f9f-8eaa-283b7733e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fd3bb9-0e19-434b-a60b-b1caf3ba7844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fd3bb9-0e19-434b-a60b-b1caf3ba7844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30892761-6480-4ba5-bcdf-3714b2d8e99b', 'volume_name': 'volume-30892761-6480-4ba5-bcdf-3714b2d8e99b', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c503d63-9dca-4059-b2d5-29a4e4a09a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c503d63-9dca-4059-b2d5-29a4e4a09a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fb626f-33fa-4e2c-a02d-1905a800ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Volume 30892761-6480-4ba5-bcdf-3714b2d8e99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30892761-6480-4ba5-bcdf-3714b2d8e99b', 'volume_size': 1} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-695588964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30892761-6480-4ba5-bcdf-3714b2d8e99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3253178cb40c4c5299821a177c5329ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:46Z,use_quota=True,user_id='714914117b0e4d76b3c992a5454c8f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Creating volume 30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:46 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:46 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b 1073741824 Nov 05 12:18:46 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-a34bdfcf-c9dd-4e7a-a691-04fc780f8769-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Lock "cinder-a34bdfcf-c9dd-4e7a-a691-04fc780f8769-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-a34bdfcf-c9dd-4e7a-a691-04fc780f8769" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-a34bdfcf-c9dd-4e7a-a691-04fc780f8769" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot a34bdfcf-c9dd-4e7a-a691-04fc780f8769 of volume 3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[844bc071-b357-4c8f-af28-0a741bb52e3f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:46 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 Nov 05 12:18:46 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:46 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b 1073741824" returned: 0 in 0.522s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:46 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b Nov 05 12:18:46 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:47 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769" returned: 0 in 0.451s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b74bdcc-17db-4a3d-869e-968f052f4967]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:47 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b" returned: 0 in 0.319s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fb626f-33fa-4e2c-a02d-1905a800ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30892761-6480-4ba5-bcdf-3714b2d8e99b', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075e6eee-948b-49c6-a5dc-d61c916206d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:47 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Volume volume-30892761-6480-4ba5-bcdf-3714b2d8e99b (30892761-6480-4ba5-bcdf-3714b2d8e99b): created successfully Nov 05 12:18:47 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 Nov 05 12:18:47 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075e6eee-948b-49c6-a5dc-d61c916206d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Flow 'volume_create_manager' (e38e8620-1941-43af-aaa1-f6926da9bc9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:47 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4c52d026-fbf7-4868-b553-30d84ba0c00d tempest-SnapshotDependencyTests-749839404 None] Created volume successfully. Nov 05 12:18:47 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" returned: 0 in 0.390s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:47 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 Nov 05 12:18:47 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:47 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769" returned: 0 in 0.384s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:47 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769 Nov 05 12:18:47 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:48 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1.a34bdfcf-c9dd-4e7a-a691-04fc780f8769" returned: 0 in 0.276s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-a34bdfcf-c9dd-4e7a-a691-04fc780f8769" released by "_delete_snapshot" :: held 1.660s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" released by "delete_snapshot" :: held 1.686s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Created reservations ['9d6057b3-c6e6-4b08-89ec-3dd5d6aa5e58', '64461ef7-77ad-4958-a118-68b3b97c4809', '3c21b881-c4d0-4ebc-aafb-afe2345decb2', 'c4487120-d90d-451a-8910-d79d7ba1ed6b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:48 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e6e62843-3745-41f2-9283-0ce4995e645d tempest-ProjectMemberTests-2050865409 None] Lock "cinder-a34bdfcf-c9dd-4e7a-a691-04fc780f8769-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Creating offline snapshot a0522dd1-bf5c-437c-9c5b-f49477d8e04d of volume 30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c6246a-ecda-4b54-b06f-6c8cab18e41e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:48 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b Nov 05 12:18:48 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-3a37f8f0-b735-4d5d-a614-eb4573bc03e1-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-3a37f8f0-b735-4d5d-a614-eb4573bc03e1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:48 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" acquired by "delete_volume" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad048db-d20d-4a94-8154-c167cdfc8a2d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:49 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b" returned: 0 in 0.553s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:49 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:49 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:49 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d 1G Nov 05 12:18:49 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:49 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" returned: 0 in 0.486s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:49 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1 Nov 05 12:18:49 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:49 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d 1G" returned: 0 in 0.565s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30892761-6480-4ba5-bcdf-3714b2d8e99b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:49 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30892761-6480-4ba5-bcdf-3714b2d8e99b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d Nov 05 12:18:49 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:49 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" returned: 0 in 0.331s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (898b55b7-0a4c-4df5-880b-59a5b09d349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1c45ca-ddfb-41a1-bc97-f9b9164f9df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a37f8f0-b735-4d5d-a614-eb4573bc03e1" released by "delete_volume" :: held 0.968s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1c45ca-ddfb-41a1-bc97-f9b9164f9df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115311053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a81f9bc-f1ef-4cc0-8418-3651df6175a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:50Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dc68c9-7845-4de1-8218-7bb27556d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dc68c9-7845-4de1-8218-7bb27556d52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacecdfc-3bcf-4746-a705-8acc5c332f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacecdfc-3bcf-4746-a705-8acc5c332f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a81f9bc-f1ef-4cc0-8418-3651df6175a4', 'volume_name': 'volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9eafe-0ffe-458b-b087-4ba77a8a2523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9eafe-0ffe-458b-b087-4ba77a8a2523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33ee3bc-264c-4d10-9498-f0270f4670c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:49 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Volume 6a81f9bc-f1ef-4cc0-8418-3651df6175a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4', 'volume_size': 1} Nov 05 12:18:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Created reservations ['5720c029-144e-42eb-ab83-807396ecc84c', 'cb5f20d8-a72f-4888-8acc-849ab6e2b4e9', '52ece030-f023-4143-b9ee-442f748c5181', '0d64f99c-4429-4d54-ae37-73ee8740bfe2'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:50 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30892761-6480-4ba5-bcdf-3714b2d8e99b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d" returned: 0 in 0.373s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:50 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d is being set with open permissions: ugo+rw Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:50 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:50 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:50 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d Nov 05 12:18:50 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:50 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.265s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:18:50 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d" returned: 0 in 0.262s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aa36ca5e-e66d-4f4d-9434-06bac6051564 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-3a37f8f0-b735-4d5d-a614-eb4573bc03e1-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:50 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.info Nov 05 12:18:50 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:50 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.info" returned: 0 in 0.265s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:50 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.info is being set with open permissions: ugo+rw Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:50 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.info Nov 05 12:18:50 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:50 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.info" returned: 0 in 0.248s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.992s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115311053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a81f9bc-f1ef-4cc0-8418-3651df6175a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:50Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Creating volume 6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:50 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:50 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 1073741824 Nov 05 12:18:50 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:50 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-8d7bdd01-f770-462e-ab63-2cf6af4afdab tempest-SnapshotDependencyTests-749839404 None] Create snapshot completed successfully Nov 05 12:18:51 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 1073741824" returned: 0 in 0.530s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:51 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 Nov 05 12:18:51 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (214f9c53-5c2f-45a4-bc87-1cc7cedc7169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a932cd-840a-4f0c-8c5e-78f9fd6cca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a932cd-840a-4f0c-8c5e-78f9fd6cca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-632581483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e158659f-3c18-460f-a6e5-f5cf0b0e482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:52Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68fadf5-5493-41df-aa34-6b9d2a34a4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68fadf5-5493-41df-aa34-6b9d2a34a4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f925d3b-aee9-4285-bfe9-3633e374e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f925d3b-aee9-4285-bfe9-3633e374e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e158659f-3c18-460f-a6e5-f5cf0b0e482d', 'volume_name': 'volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825d1a00-af5c-46f2-9fcc-4e49a15d7c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825d1a00-af5c-46f2-9fcc-4e49a15d7c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb792bb7-0bf4-445d-a81b-a5a4ff724ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Volume e158659f-3c18-460f-a6e5-f5cf0b0e482d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d', 'volume_size': 1} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:51 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" returned: 0 in 0.271s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-632581483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e158659f-3c18-460f-a6e5-f5cf0b0e482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:52Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Creating volume e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:51 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:51 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d 1073741824 Nov 05 12:18:51 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33ee3bc-264c-4d10-9498-f0270f4670c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75663c4d-8aaf-4ee1-84e7-0215a95345f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:51 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Volume volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 (6a81f9bc-f1ef-4cc0-8418-3651df6175a4): created successfully Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75663c4d-8aaf-4ee1-84e7-0215a95345f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:51 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (898b55b7-0a4c-4df5-880b-59a5b09d349d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-98fb5c19-8fd8-40b6-b7b9-1b8a695c8648 tempest-ProjectReaderTests-1345879390 None] Created volume successfully. Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (a0d19b0f-b057-4749-b12b-d2a8fab6cc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a107125-e753-4fdb-8082-c4d24c7c77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a107125-e753-4fdb-8082-c4d24c7c77d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-399866560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6f6d29-a42f-4806-a779-92742dbac54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:52Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb7a754-34c2-4543-bdcb-e7c1620f9aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb7a754-34c2-4543-bdcb-e7c1620f9aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf07dbe-03ab-40a9-87d9-97369bfea40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf07dbe-03ab-40a9-87d9-97369bfea40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6f6d29-a42f-4806-a779-92742dbac54d', 'volume_name': 'volume-5b6f6d29-a42f-4806-a779-92742dbac54d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8741b8a-d1af-4a47-b042-28c75239d685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8741b8a-d1af-4a47-b042-28c75239d685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5689fe7f-62c3-4e7d-ad73-4d35f8c4fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Volume 5b6f6d29-a42f-4806-a779-92742dbac54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6f6d29-a42f-4806-a779-92742dbac54d', 'volume_size': 1} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:52 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d 1073741824" returned: 0 in 0.564s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:52 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d Nov 05 12:18:52 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Flow 'volume_create_manager' (8cbad99b-ea70-47a4-83a9-efb53c24ba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30176698-4769-44f0-96c6-a169c94541fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30176698-4769-44f0-96c6-a169c94541fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19a9616-901a-4696-9297-fcb26942653b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3253178cb40c4c5299821a177c5329ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0522dd1-bf5c-437c-9c5b-f49477d8e04d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:52Z,use_quota=True,user_id='714914117b0e4d76b3c992a5454c8f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72046644-5f7c-41d3-b211-b99d2cc2384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72046644-5f7c-41d3-b211-b99d2cc2384f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9856ab5e-b794-4978-8837-72cf910aa6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9856ab5e-b794-4978-8837-72cf910aa6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e19a9616-901a-4696-9297-fcb26942653b', 'volume_name': 'volume-e19a9616-901a-4696-9297-fcb26942653b', 'volume_size': 1, 'snapshot_id': 'a0522dd1-bf5c-437c-9c5b-f49477d8e04d'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbefc27-bb28-422f-b605-8ac1c1194d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbefc27-bb28-422f-b605-8ac1c1194d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a9694b-24f5-40b4-b157-89bc5cbea719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Volume e19a9616-901a-4696-9297-fcb26942653b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e19a9616-901a-4696-9297-fcb26942653b', 'volume_size': 1, 'snapshot_id': 'a0522dd1-bf5c-437c-9c5b-f49477d8e04d'} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:52 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:52 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:52 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d" returned: 0 in 0.258s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-399866560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6f6d29-a42f-4806-a779-92742dbac54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:52Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Creating volume 5b6f6d29-a42f-4806-a779-92742dbac54d {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:52 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:52 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d 1073741824 Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb792bb7-0bf4-445d-a81b-a5a4ff724ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9963d460-58eb-487b-8c6a-ee06acbfb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:52 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Volume volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d (e158659f-3c18-460f-a6e5-f5cf0b0e482d): created successfully Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9963d460-58eb-487b-8c6a-ee06acbfb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (214f9c53-5c2f-45a4-bc87-1cc7cedc7169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:52 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1384b719-c6fe-47af-afa7-0899ee103e83 tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:18:52 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:18:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:53 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d 1073741824" returned: 0 in 0.491s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:53 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d Nov 05 12:18:53 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:53 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.901s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-quobyte-a0522dd1-bf5c-437c-9c5b-f49477d8e04d-e19a9616-901a-4696-9297-fcb26942653b" by "_create_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5689fe7f-62c3-4e7d-ad73-4d35f8c4fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6f6d29-a42f-4806-a779-92742dbac54d', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c68e538-e548-42a0-8e0c-b791bfd29758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-a0522dd1-bf5c-437c-9c5b-f49477d8e04d-e19a9616-901a-4696-9297-fcb26942653b" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Creating volume e19a9616-901a-4696-9297-fcb26942653b from snapshot a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-quobyte-e19a9616-901a-4696-9297-fcb26942653b" by "_copy_volume_from_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:53 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Volume volume-5b6f6d29-a42f-4806-a779-92742dbac54d (5b6f6d29-a42f-4806-a779-92742dbac54d): created successfully Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c68e538-e548-42a0-8e0c-b791bfd29758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (a0d19b0f-b057-4749-b12b-d2a8fab6cc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-e19a9616-901a-4696-9297-fcb26942653b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] snapshot: a0522dd1-bf5c-437c-9c5b-f49477d8e04d, volume: e19a9616-901a-4696-9297-fcb26942653b, {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 12:18:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-61cb6257-dc7e-4662-8a02-001762771175 tempest-ProjectReaderTests-1646427182 None] Created volume successfully. Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd302ce-5ec4-4c39-85e9-ed40bee7ed49]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:53 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d Nov 05 12:18:53 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:53 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d" returned: 0 in 0.383s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30892761-6480-4ba5-bcdf-3714b2d8e99b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9172ff-ba0d-40a3-a5db-2a9cb81b6642]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:54 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b Nov 05 12:18:54 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-5b6f6d29-a42f-4806-a779-92742dbac54d-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Lock "cinder-5b6f6d29-a42f-4806-a779-92742dbac54d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-quobyte-5b6f6d29-a42f-4806-a779-92742dbac54d" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-5b6f6d29-a42f-4806-a779-92742dbac54d" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:18:54 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b" returned: 0 in 0.414s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Creating direct copy from snapshot {{(pid=86942) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG cinder.utils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Path /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b not found in is_blk_device check {{(pid=86942) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d917c-7bba-4ec9-abc5-4f71b40d3198]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:54 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b Nov 05 12:18:54 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:54 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d Nov 05 12:18:54 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:54 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d" returned: 0 in 0.380s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:54 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d Nov 05 12:18:54 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:55 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b6f6d29-a42f-4806-a779-92742dbac54d" returned: 0 in 0.430s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-5b6f6d29-a42f-4806-a779-92742dbac54d" released by "delete_volume" :: held 0.883s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Created reservations ['af272a86-275b-44ec-bb56-a91c32abb745', '4ed1f964-c8ea-4391-8e39-658b89b6d350', '24e9fd2c-de6f-482b-9729-a38df3b4f86f', '36442238-9e79-4989-b029-1c6a3a3bee6a'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:18:55 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:18:55 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:18:55 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.367s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:18:55 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:18:55 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Deleted volume successfully. Nov 05 12:18:56 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-d962d72d-d2d3-4ca5-97cb-b6dea6c003c4 tempest-ProjectReaderTests-1646427182 None] Lock "cinder-5b6f6d29-a42f-4806-a779-92742dbac54d-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (243480fe-62fb-4162-87f9-d52d5f1971fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f957c2-e0e3-477b-9542-17802ec579cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f957c2-e0e3-477b-9542-17802ec579cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883090023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e921ca0-5f75-466f-b823-32a3e93c5c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:57Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a3650e-9e21-455f-8a68-660d5a849f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a3650e-9e21-455f-8a68-660d5a849f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0505eb8-e5ab-43f1-8370-539eaab72d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0505eb8-e5ab-43f1-8370-539eaab72d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e921ca0-5f75-466f-b823-32a3e93c5c50', 'volume_name': 'volume-3e921ca0-5f75-466f-b823-32a3e93c5c50', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff9e2f9-5e26-4401-a019-537968c4a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff9e2f9-5e26-4401-a019-537968c4a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19bfb24-4bf9-4951-84c9-ad223966e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:18:57 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Volume 3e921ca0-5f75-466f-b823-32a3e93c5c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e921ca0-5f75-466f-b823-32a3e93c5c50', 'volume_size': 1} Nov 05 12:18:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:00 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b" returned: 0 in 6.267s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG cinder.image.image_utils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Image conversion details: src /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b {{(pid=86942) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 12:19:00 devstack cinder-volume[86942]: INFO cinder.image.image_utils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Converted 1024.00 MB image at 163.38 MB/s Nov 05 12:19:00 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b is being set with open permissions: ugo+rw Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:00 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b Nov 05 12:19:00 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:00 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-e19a9616-901a-4696-9297-fcb26942653b" released by "_copy_volume_from_snapshot" :: held 7.393s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-a0522dd1-bf5c-437c-9c5b-f49477d8e04d-e19a9616-901a-4696-9297-fcb26942653b" released by "_create_volume_from_snapshot" :: held 7.470s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.500s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.866s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Creating offline snapshot 444e0571-ebd4-458e-be8c-d4146d915999 of volume 6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a9694b-24f5-40b4-b157-89bc5cbea719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19a9616-901a-4696-9297-fcb26942653b', 'volume_size': 1, 'snapshot_id': 'a0522dd1-bf5c-437c-9c5b-f49477d8e04d'}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99ca25e-f6ce-485d-915e-ba78a95b77d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b2c9a1-8bc9-486b-9cb3-47f574fa5edd]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:01 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Volume volume-e19a9616-901a-4696-9297-fcb26942653b (e19a9616-901a-4696-9297-fcb26942653b): created successfully Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99ca25e-f6ce-485d-915e-ba78a95b77d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Flow 'volume_create_manager' (8cbad99b-ea70-47a4-83a9-efb53c24ba76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:01 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0bbabb1e-41b4-4c26-95e1-6f406ef71cf5 tempest-SnapshotDependencyTests-749839404 None] Created volume successfully. Nov 05 12:19:01 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 Nov 05 12:19:01 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:01 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:01 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 1G Nov 05 12:19:01 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:01 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 1G" returned: 0 in 0.374s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:01 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:01 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 Nov 05 12:19:01 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:02 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999" returned: 0 in 0.288s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:02 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 is being set with open permissions: ugo+rw Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:02 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 Nov 05 12:19:02 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-a0522dd1-bf5c-437c-9c5b-f49477d8e04d-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-a0522dd1-bf5c-437c-9c5b-f49477d8e04d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-quobyte-30892761-6480-4ba5-bcdf-3714b2d8e99b" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-30892761-6480-4ba5-bcdf-3714b2d8e99b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-quobyte-a0522dd1-bf5c-437c-9c5b-f49477d8e04d" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-a0522dd1-bf5c-437c-9c5b-f49477d8e04d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Deleting offline snapshot a0522dd1-bf5c-437c-9c5b-f49477d8e04d of volume 30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] snapshot_file for this snap is: volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b3cb21-1f89-426f-a5f9-9b896113ed79]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:02 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999" returned: 0 in 0.242s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:02 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.info Nov 05 12:19:02 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:02 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d Nov 05 12:19:02 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:02 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.info" returned: 0 in 0.255s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:02 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.info is being set with open permissions: ugo+rw Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:02 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.info Nov 05 12:19:02 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:02 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d" returned: 0 in 0.362s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30892761-6480-4ba5-bcdf-3714b2d8e99b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c43057-4286-41c7-8446-6037fa5d9407]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:02 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b Nov 05 12:19:02 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:02 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.info" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.080s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot 2b1279a0-c635-4f9f-8234-bc936b96643a of volume e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:02 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-d7e89378-a742-4d72-8f1a-182ef8734521 tempest-ProjectReaderTests-1345879390 None] Create snapshot completed successfully Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c84d71d-9e04-4d93-8cbe-7482bd5b1681]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:03 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d Nov 05 12:19:03 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:03 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b" returned: 0 in 0.536s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:03 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d Nov 05 12:19:03 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:03 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d" returned: 0 in 0.360s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:03 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a 1G Nov 05 12:19:03 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:03 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d" returned: 0 in 0.344s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:03 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d Nov 05 12:19:03 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:03 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a 1G" returned: 0 in 0.417s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:03 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a Nov 05 12:19:03 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-444e0571-ebd4-458e-be8c-d4146d915999-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-444e0571-ebd4-458e-be8c-d4146d915999-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-444e0571-ebd4-458e-be8c-d4146d915999" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:03 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b.a0522dd1-bf5c-437c-9c5b-f49477d8e04d" returned: 0 in 0.276s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-444e0571-ebd4-458e-be8c-d4146d915999" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Deleting offline snapshot 444e0571-ebd4-458e-be8c-d4146d915999 of volume 6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] snapshot_file for this snap is: volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb6354-1330-4177-aeda-9c821053d833]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-a0522dd1-bf5c-437c-9c5b-f49477d8e04d" released by "_delete_snapshot" :: held 1.662s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:03 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-30892761-6480-4ba5-bcdf-3714b2d8e99b" released by "delete_snapshot" :: held 1.693s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Created reservations ['72229428-a3d7-4534-9911-f11747df337f', '572593f0-2bd4-44b9-8941-5552df285e59', '651ace4b-2e88-4bc2-9c35-b2a03d4db1bb', 'db2b1e9c-03f6-41aa-8297-a7b579659230'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:04 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a" returned: 0 in 0.327s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:04 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a is being set with open permissions: ugo+rw Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 Nov 05 12:19:04 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a Nov 05 12:19:04 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Delete snapshot completed successfully. Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-a3ebca2d-68c2-4f1a-90f2-0e79aeef1004 tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-a0522dd1-bf5c-437c-9c5b-f49477d8e04d-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:04 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a" returned: 0 in 0.252s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:04 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999" returned: 0 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07cddb7-57c5-436a-94c6-b9d6f54606a3]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.info Nov 05 12:19:04 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-30892761-6480-4ba5-bcdf-3714b2d8e99b-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-30892761-6480-4ba5-bcdf-3714b2d8e99b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-quobyte-30892761-6480-4ba5-bcdf-3714b2d8e99b" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:04 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 Nov 05 12:19:04 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-30892761-6480-4ba5-bcdf-3714b2d8e99b" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ed74e6-0729-4e34-aa15-3ff6d6c57de2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.info" returned: 0 in 0.272s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:04 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.info is being set with open permissions: ugo+rw Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.info Nov 05 12:19:04 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b Nov 05 12:19:04 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" returned: 0 in 0.387s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 Nov 05 12:19:04 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.info" returned: 0 in 0.246s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.164s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883090023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e921ca0-5f75-466f-b823-32a3e93c5c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:18:57Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Creating volume 3e921ca0-5f75-466f-b823-32a3e93c5c50 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:04 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 1073741824 Nov 05 12:19:04 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:04 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b" returned: 0 in 0.414s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:04 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-382249ae-c9ff-41dd-9947-c563fe6c4e18 tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:19:04 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b Nov 05 12:19:04 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:05 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999" returned: 0 in 0.378s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:05 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999 Nov 05 12:19:05 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:05 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-30892761-6480-4ba5-bcdf-3714b2d8e99b" returned: 0 in 0.259s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-30892761-6480-4ba5-bcdf-3714b2d8e99b" released by "delete_volume" :: held 0.733s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Created reservations ['cf5fa75f-b967-44ee-84bf-05f3cde17333', '0ca94a2e-d1cf-4764-b6e5-9785465670b4', '70290a61-4252-4e38-8127-4880710dfc23', '5e7da562-16a5-4863-ae72-913618bf2668'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-2b1279a0-c635-4f9f-8234-bc936b96643a-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:05 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4.444e0571-ebd4-458e-be8c-d4146d915999" returned: 0 in 0.279s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:05 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:05 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:05 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 1073741824" returned: 0 in 0.537s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Lock "cinder-2b1279a0-c635-4f9f-8234-bc936b96643a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-e158659f-3c18-460f-a6e5-f5cf0b0e482d" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-444e0571-ebd4-458e-be8c-d4146d915999" released by "_delete_snapshot" :: held 1.566s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" released by "delete_snapshot" :: held 1.599s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-e158659f-3c18-460f-a6e5-f5cf0b0e482d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-2b1279a0-c635-4f9f-8234-bc936b96643a" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-2b1279a0-c635-4f9f-8234-bc936b96643a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot 2b1279a0-c635-4f9f-8234-bc936b96643a of volume e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35c9ea7-8516-4340-9623-a999c09b22bc]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:05 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 Nov 05 12:19:05 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-e19a9616-901a-4696-9297-fcb26942653b-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Created reservations ['88929822-78b0-4c32-bde8-937f60dfa596', 'b483d917-6281-40e0-80b6-3032923d6a27', '0ce52e66-c4a2-489c-a8bc-61373f4ee383', '9fba0aa2-af25-421c-9a0c-d04c53fa9559'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:05 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-e19a9616-901a-4696-9297-fcb26942653b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.299s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Deleted volume successfully. Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1f6063a7-ef53-45f9-ac77-9953f53a7dfd tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-30892761-6480-4ba5-bcdf-3714b2d8e99b-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:05 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a Nov 05 12:19:05 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "cinder-quobyte-e19a9616-901a-4696-9297-fcb26942653b" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Delete snapshot completed successfully. Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-3d3ac104-f5b2-41e1-b455-77ec036d1018 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-444e0571-ebd4-458e-be8c-d4146d915999-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-e19a9616-901a-4696-9297-fcb26942653b" acquired by "delete_volume" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4529b36-8eb8-47ee-888e-0988c5b9503d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:05 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50" returned: 0 in 0.358s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:05 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b Nov 05 12:19:05 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19bfb24-4bf9-4951-84c9-ad223966e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e921ca0-5f75-466f-b823-32a3e93c5c50', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b2497a-287e-4150-a9d4-3d9613f7c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Volume volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 (3e921ca0-5f75-466f-b823-32a3e93c5c50): created successfully Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b2497a-287e-4150-a9d4-3d9613f7c68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (243480fe-62fb-4162-87f9-d52d5f1971fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-05b51b2e-62de-40f0-88fb-cf226241fe53 tempest-ProjectReaderTests-1646427182 None] Created volume successfully. Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-6a81f9bc-f1ef-4cc0-8418-3651df6175a4-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-6a81f9bc-f1ef-4cc0-8418-3651df6175a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:06 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a" returned: 0 in 0.517s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedfbac8-149e-40a9-bdde-f71c5122448e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[13de6496-59a2-4615-b7c7-ed4745aaaeb5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:06 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b" returned: 0 in 0.428s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:06 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d Nov 05 12:19:06 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:06 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b Nov 05 12:19:06 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:06 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 Nov 05 12:19:06 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:06 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e19a9616-901a-4696-9297-fcb26942653b" returned: 0 in 0.261s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-quobyte-e19a9616-901a-4696-9297-fcb26942653b" released by "delete_volume" :: held 0.739s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:06 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d" returned: 0 in 0.401s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:06 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a Nov 05 12:19:06 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:06 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Created reservations ['e120ca76-a060-4bf1-8b63-165471c89fd5', '258ee2a6-747e-4995-8e63-c0be7cb68dda', '9e2b78be-cb38-467e-aad1-95adfb994cfd', 'ac814002-ea9d-4bd7-983c-203a3fc95fde'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" returned: 0 in 0.388s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:06 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4 Nov 05 12:19:06 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:06 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:06 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:06 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" returned: 0 in 0.267s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-6a81f9bc-f1ef-4cc0-8418-3651df6175a4" released by "delete_volume" :: held 0.729s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:06 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a" returned: 0 in 0.417s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:06 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:06 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a Nov 05 12:19:06 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.314s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Deleted volume successfully. Nov 05 12:19:06 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Created reservations ['d4733758-bc62-4098-8ba0-8e23af93b5a0', 'a39b3675-a9ff-465b-876a-d32e5048bfda', '5feaa58b-1e9c-4ca5-9767-d2806e90d81d', '4aee1641-5904-43f2-a6a5-a5c12831506e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-b06469d3-98db-4399-a590-439f0d3826ad tempest-SnapshotDependencyTests-749839404 None] Lock "cinder-e19a9616-901a-4696-9297-fcb26942653b-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:07 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:07 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-3e921ca0-5f75-466f-b823-32a3e93c5c50-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:07 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d.2b1279a0-c635-4f9f-8234-bc936b96643a" returned: 0 in 0.368s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Lock "cinder-3e921ca0-5f75-466f-b823-32a3e93c5c50-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-2b1279a0-c635-4f9f-8234-bc936b96643a" released by "_delete_snapshot" :: held 1.874s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-e158659f-3c18-460f-a6e5-f5cf0b0e482d" released by "delete_snapshot" :: held 1.920s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-quobyte-3e921ca0-5f75-466f-b823-32a3e93c5c50" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:07 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-3e921ca0-5f75-466f-b823-32a3e93c5c50" acquired by "delete_volume" :: waited 0.044s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:07 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Deleted volume successfully. Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a42c81-37cd-4b6d-b33c-a6c5a6fbf638]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c5ab2e35-8645-4a86-b05c-98ba3062dc12 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-6a81f9bc-f1ef-4cc0-8418-3651df6175a4-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Created reservations ['1548f3ed-ec1e-455c-b953-074da6d8b14d', '72360ebb-e837-4c1a-a922-727e13550bd0', '89f462fe-ebd2-485b-ab70-87f22cb52ed3', '5ad225dc-75e2-4418-b857-0b4a1903be8f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:07 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-424334bc-4902-459d-a7e1-c73443bbff6c tempest-ProjectMemberTests-2050865409 None] Lock "cinder-2b1279a0-c635-4f9f-8234-bc936b96643a-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:07 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 Nov 05 12:19:07 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (9639e78d-d0a4-4481-b7b9-74b715bbb921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e806bfe-5888-4edb-9830-d073bbfb07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e806bfe-5888-4edb-9830-d073bbfb07d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646896471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbdd2c3-892c-45f1-82d3-bd60f7585371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:08Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9373075f-5408-4edc-9511-47424b50139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9373075f-5408-4edc-9511-47424b50139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3bce07-98a9-4723-8a73-e18ec211c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3bce07-98a9-4723-8a73-e18ec211c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbdd2c3-892c-45f1-82d3-bd60f7585371', 'volume_name': 'volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34a35fc-d11d-4df7-947b-21a19b9ee695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34a35fc-d11d-4df7-947b-21a19b9ee695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edf1666-4e33-4f76-91c0-87f209d22e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:07 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Volume 3dbdd2c3-892c-45f1-82d3-bd60f7585371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371', 'volume_size': 1} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646896471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbdd2c3-892c-45f1-82d3-bd60f7585371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:08Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Creating volume 3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:07 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:08 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 1073741824 Nov 05 12:19:08 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:08 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50" returned: 0 in 0.508s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:08 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50 Nov 05 12:19:08 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:08 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3e921ca0-5f75-466f-b823-32a3e93c5c50" returned: 0 in 0.249s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-3e921ca0-5f75-466f-b823-32a3e93c5c50" released by "delete_volume" :: held 0.829s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Created reservations ['2e48738e-d5da-42c9-a009-0b732f3b74a7', '8a134312-a228-4c38-b007-94cbeea8b4be', 'f031b4a0-8961-4133-8a55-1d6032c45f21', '11c0ed4a-b754-498a-b7a3-638b3e2473f8'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:08 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:08 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:08 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 1073741824" returned: 0 in 0.558s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:08 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 Nov 05 12:19:08 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-e158659f-3c18-460f-a6e5-f5cf0b0e482d-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:08 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.324s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:08 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Deleted volume successfully. Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-e158659f-3c18-460f-a6e5-f5cf0b0e482d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-aecaf1fd-4b8b-455b-b687-d023cb09adcc tempest-ProjectReaderTests-1646427182 None] Lock "cinder-3e921ca0-5f75-466f-b823-32a3e93c5c50-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-e158659f-3c18-460f-a6e5-f5cf0b0e482d" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-e158659f-3c18-460f-a6e5-f5cf0b0e482d" acquired by "delete_volume" :: waited 0.039s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c616d-f1bf-4132-80e2-699e91924042]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:08 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:09 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371" returned: 0 in 0.393s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edf1666-4e33-4f76-91c0-87f209d22e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9964963b-b54c-4497-b746-622721aae3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:09 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Volume volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 (3dbdd2c3-892c-45f1-82d3-bd60f7585371): created successfully Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9964963b-b54c-4497-b746-622721aae3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (9639e78d-d0a4-4481-b7b9-74b715bbb921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:09 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d Nov 05 12:19:09 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:09 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fae2fc10-3d44-48e3-9f7a-cafc11f2f6e4 tempest-ProjectReaderTests-1345879390 None] Created volume successfully. Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (603e760f-1b6e-4ee3-9ff9-e06775f37a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28289bd6-e2ee-4eb6-8fe2-e6da9bc83115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28289bd6-e2ee-4eb6-8fe2-e6da9bc83115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48400350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97746964-2da1-43a3-8f3a-1f3bb339c4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:09Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdab0eaa-00ce-48d8-88b6-8e8d38181e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdab0eaa-00ce-48d8-88b6-8e8d38181e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbefa21-2e62-422b-9405-d993f06acd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbefa21-2e62-422b-9405-d993f06acd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97746964-2da1-43a3-8f3a-1f3bb339c4ea', 'volume_name': 'volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300ac019-86be-4777-a50a-4132b7df6211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300ac019-86be-4777-a50a-4132b7df6211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5073a1c1-5cbe-4807-b13f-0574ff932e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:09 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Volume 97746964-2da1-43a3-8f3a-1f3bb339c4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea', 'volume_size': 1} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48400350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97746964-2da1-43a3-8f3a-1f3bb339c4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:09Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Creating volume 97746964-2da1-43a3-8f3a-1f3bb339c4ea {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:09 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:09 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea 1073741824 Nov 05 12:19:09 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:09 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d" returned: 0 in 0.401s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:09 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d Nov 05 12:19:09 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:09 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-e158659f-3c18-460f-a6e5-f5cf0b0e482d" returned: 0 in 0.275s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-e158659f-3c18-460f-a6e5-f5cf0b0e482d" released by "delete_volume" :: held 0.780s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:09 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea 1073741824" returned: 0 in 0.479s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Created reservations ['43b091c5-9603-4676-8055-47d61442f8a2', 'de57be07-0e48-4a02-a6a6-a4b8b5133b2a', '4889f967-20d8-441d-bf6a-8ab2fc403702', '06b53f28-84b9-4835-9166-eb5beca70d0d'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:09 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea Nov 05 12:19:09 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:09 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:09 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:09 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:10 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea" returned: 0 in 0.359s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5073a1c1-5cbe-4807-b13f-0574ff932e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44491e24-3be0-4d6e-bb96-f853ae49f30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:10 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Volume volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea (97746964-2da1-43a3-8f3a-1f3bb339c4ea): created successfully Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44491e24-3be0-4d6e-bb96-f853ae49f30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (603e760f-1b6e-4ee3-9ff9-e06775f37a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-494f9b76-2ea1-4177-a1b7-0121dd969649 tempest-ProjectReaderTests-1646427182 None] Created volume successfully. Nov 05 12:19:10 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.346s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:10 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dd50a6ee-1efc-4d79-a5a2-f660305095a9 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-e158659f-3c18-460f-a6e5-f5cf0b0e482d-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Creating offline snapshot 1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 of volume 3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54145ff-8796-4169-8e4c-4cd209ed9567]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:10 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 Nov 05 12:19:10 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (2891f762-8324-4c09-87a2-d076b3ec47f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f549a6e1-ba6e-48b6-975f-5bb8d405c281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f549a6e1-ba6e-48b6-975f-5bb8d405c281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651083244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a85f912-3637-4e20-903b-583516633f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:11Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3ff148-5bfa-4120-a342-ddeae74ee56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3ff148-5bfa-4120-a342-ddeae74ee56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4538e8b0-0a24-4662-a768-478cf3498ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4538e8b0-0a24-4662-a768-478cf3498ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a85f912-3637-4e20-903b-583516633f88', 'volume_name': 'volume-3a85f912-3637-4e20-903b-583516633f88', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcab112-30ea-4059-8806-1a9651be86b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcab112-30ea-4059-8806-1a9651be86b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29deb260-b6c3-4f3a-b0fd-43a9378c7162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:10 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Volume 3a85f912-3637-4e20-903b-583516633f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a85f912-3637-4e20-903b-583516633f88', 'volume_size': 1} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:10 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371" returned: 0 in 0.385s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:10 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:10 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 1G Nov 05 12:19:10 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:11 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 1G" returned: 0 in 0.507s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-97746964-2da1-43a3-8f3a-1f3bb339c4ea-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:11 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 Nov 05 12:19:11 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-97746964-2da1-43a3-8f3a-1f3bb339c4ea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-quobyte-97746964-2da1-43a3-8f3a-1f3bb339c4ea" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-97746964-2da1-43a3-8f3a-1f3bb339c4ea" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8666bf4-d0f0-484c-9f8c-cd69afad24ee]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:11 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea Nov 05 12:19:11 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:11 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" returned: 0 in 0.393s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:11 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 is being set with open permissions: ugo+rw Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:11 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 Nov 05 12:19:11 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:11 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea" returned: 0 in 0.495s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:11 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" returned: 0 in 0.296s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:11 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea Nov 05 12:19:11 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:11 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:12 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.info Nov 05 12:19:12 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:12 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-97746964-2da1-43a3-8f3a-1f3bb339c4ea" returned: 0 in 0.345s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-97746964-2da1-43a3-8f3a-1f3bb339c4ea" released by "delete_volume" :: held 0.903s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:12 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.info" returned: 0 in 0.339s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:12 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.info is being set with open permissions: ugo+rw Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Created reservations ['66e1ab46-4bdc-4d66-a6fb-92ea2a2460aa', 'bb8e8fe0-4167-42fa-bf34-ccc825fce464', '5668d639-f777-47de-abd4-3a152aea5f80', '7569c832-3c5d-43fe-b9ed-6540fe6f914b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:12 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.info Nov 05 12:19:12 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:12 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:12 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:12 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.info" returned: 0 in 0.276s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.936s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651083244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a85f912-3637-4e20-903b-583516633f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:11Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Creating volume 3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:12 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:12 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 1073741824 Nov 05 12:19:12 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:12 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.274s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:12 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Deleted volume successfully. Nov 05 12:19:12 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-fa0f8bbe-3d7e-40bb-ba73-19aa27d25ba7 tempest-ProjectReaderTests-1345879390 None] Create snapshot completed successfully Nov 05 12:19:12 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bd6e5d0d-c370-4e66-8cce-c8bf97f1fbcf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-97746964-2da1-43a3-8f3a-1f3bb339c4ea-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:13 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 1073741824" returned: 0 in 0.563s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:13 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 Nov 05 12:19:13 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (679257c9-e48b-4395-877e-7bacb23d5fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f69bc3-5fb4-49aa-9152-e79424f8da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f69bc3-5fb4-49aa-9152-e79424f8da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158422897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ae49b1-884c-47ae-b291-f2a3932735f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:13Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bce58d-698f-4a9e-b1b2-6a4be512ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bce58d-698f-4a9e-b1b2-6a4be512ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d1ecd-a9f1-4199-896f-344982c9d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d1ecd-a9f1-4199-896f-344982c9d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ae49b1-884c-47ae-b291-f2a3932735f7', 'volume_name': 'volume-b7ae49b1-884c-47ae-b291-f2a3932735f7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a879e06-4dbe-42a8-a187-9e9ff3096b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a879e06-4dbe-42a8-a187-9e9ff3096b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8b85f5-7622-4539-8d7b-ddbd0614ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Volume b7ae49b1-884c-47ae-b291-f2a3932735f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ae49b1-884c-47ae-b291-f2a3932735f7', 'volume_size': 1} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-1eef36d6-9e51-44ec-a9d4-2adea9a39ff8-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:13 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88" returned: 0 in 0.265s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158422897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ae49b1-884c-47ae-b291-f2a3932735f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f489385fa5494ef788d1fe017bcf5744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:13Z,use_quota=True,user_id='ba0793a08a464a3fb4301d6caee1a698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Creating volume b7ae49b1-884c-47ae-b291-f2a3932735f7 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:13 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-1eef36d6-9e51-44ec-a9d4-2adea9a39ff8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-3dbdd2c3-892c-45f1-82d3-bd60f7585371" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:13 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 1073741824 Nov 05 12:19:13 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29deb260-b6c3-4f3a-b0fd-43a9378c7162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a85f912-3637-4e20-903b-583516633f88', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e55485f-97aa-4113-94c9-d8ca1898aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-3dbdd2c3-892c-45f1-82d3-bd60f7585371" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:13 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Volume volume-3a85f912-3637-4e20-903b-583516633f88 (3a85f912-3637-4e20-903b-583516633f88): created successfully Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e55485f-97aa-4113-94c9-d8ca1898aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (2891f762-8324-4c09-87a2-d076b3ec47f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Deleting offline snapshot 1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 of volume 3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] snapshot_file for this snap is: volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:13 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a3f02604-fd7b-4ea9-9fb4-fb46657351ef tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb6aee7-31d3-41a8-adca-8da74dd4fdcb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:13 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:13 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 Nov 05 12:19:13 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:14 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" returned: 0 in 0.433s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:14 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 1073741824" returned: 0 in 0.628s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[de371921-742d-4aca-a0d6-ce06d94f83c5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:14 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 Nov 05 12:19:14 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:14 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 Nov 05 12:19:14 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:14 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.404s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8b85f5-7622-4539-8d7b-ddbd0614ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ae49b1-884c-47ae-b291-f2a3932735f7', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0740d74-d629-449d-a972-47f353390727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot a68b42dd-ffd4-4995-a69f-f2827d3bcc60 of volume 3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:14 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Volume volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 (b7ae49b1-884c-47ae-b291-f2a3932735f7): created successfully Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0740d74-d629-449d-a972-47f353390727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Flow 'volume_create_manager' (679257c9-e48b-4395-877e-7bacb23d5fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a17c8e-c5a6-48be-9f2b-4f5f74fc5499]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:14 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-964ce2d2-263f-4fda-b5cd-aef135c862ed tempest-ProjectReaderTests-1646427182 None] Created volume successfully. Nov 05 12:19:14 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371" returned: 0 in 0.422s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:14 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 Nov 05 12:19:14 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:14 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 Nov 05 12:19:14 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:14 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88" returned: 0 in 0.424s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:14 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:14 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 1G Nov 05 12:19:14 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:15 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" returned: 0 in 0.409s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:15 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8 Nov 05 12:19:15 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:15 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371.1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" returned: 0 in 0.268s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-1eef36d6-9e51-44ec-a9d4-2adea9a39ff8" released by "_delete_snapshot" :: held 1.693s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-3dbdd2c3-892c-45f1-82d3-bd60f7585371" released by "delete_snapshot" :: held 1.735s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-b7ae49b1-884c-47ae-b291-f2a3932735f7-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Created reservations ['6ff59326-6f1b-48e1-82ed-6cd368cb7b41', '546add94-abcf-4afa-87f5-abd2c7edfe65', 'a099f2a7-d730-4ab8-83f6-7f271813dc2d', '6140ed84-c8fc-4150-abea-a5237a2a8763'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:15 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 1G" returned: 0 in 0.457s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a85f912-3637-4e20-903b-583516633f88 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-b7ae49b1-884c-47ae-b291-f2a3932735f7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:15 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a85f912-3637-4e20-903b-583516633f88 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 Nov 05 12:19:15 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Acquiring lock "cinder-quobyte-b7ae49b1-884c-47ae-b291-f2a3932735f7" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:15 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Delete snapshot completed successfully. Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-b7ae49b1-884c-47ae-b291-f2a3932735f7" acquired by "delete_volume" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-69b0c373-94c9-466d-9ac9-87cab435a4b6 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-1eef36d6-9e51-44ec-a9d4-2adea9a39ff8-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b959da2a-a574-467b-b640-503c3e984488]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:15 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 Nov 05 12:19:15 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-3dbdd2c3-892c-45f1-82d3-bd60f7585371-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-3dbdd2c3-892c-45f1-82d3-bd60f7585371-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:15 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a85f912-3637-4e20-903b-583516633f88 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60" returned: 0 in 0.366s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:15 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 is being set with open permissions: ugo+rw Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:15 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 Nov 05 12:19:15 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-3dbdd2c3-892c-45f1-82d3-bd60f7585371" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:15 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-3dbdd2c3-892c-45f1-82d3-bd60f7585371" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d793370a-c045-4654-ace4-491750b0f7a1]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:16 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60" returned: 0 in 0.351s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:16 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7" returned: 0 in 0.607s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:16 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 Nov 05 12:19:16 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:16 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7 Nov 05 12:19:16 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:16 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.info Nov 05 12:19:16 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:16 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.info" returned: 0 in 0.270s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:16 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.info is being set with open permissions: ugo+rw Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:16 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371" returned: 0 in 0.468s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:16 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.info Nov 05 12:19:16 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:16 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371 Nov 05 12:19:16 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:16 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-b7ae49b1-884c-47ae-b291-f2a3932735f7" returned: 0 in 0.368s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-quobyte-b7ae49b1-884c-47ae-b291-f2a3932735f7" released by "delete_volume" :: held 1.036s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Created reservations ['b4c5b133-34c1-44be-9e43-82fc905833bf', '8008fa9e-9392-4c13-8043-7d82ae9fff66', '28552146-2ba7-4255-b82e-c6818759d715', 'ffefa971-aa30-4207-80d9-002800fc567f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:16 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:16 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:16 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.info" returned: 0 in 0.330s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:16 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3dbdd2c3-892c-45f1-82d3-bd60f7585371" returned: 0 in 0.334s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-3dbdd2c3-892c-45f1-82d3-bd60f7585371" released by "delete_volume" :: held 0.971s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:16 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-eaa09a01-99eb-425e-94a4-890a69677a03 tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:19:16 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Created reservations ['178bd8f6-35f0-40cd-8415-1d46a656b802', 'c85b0816-01c3-4dfd-9800-ffa756ef9560', '23d30bbc-1857-4b53-8660-a971fdc23d24', '9799a9e8-e4fd-41ad-bda2-a25357b353b3'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:17 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:17 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:17 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.410s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Deleted volume successfully. Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5b1f7149-8eee-46bd-b831-1b35a81f5daf tempest-ProjectReaderTests-1646427182 None] Lock "cinder-b7ae49b1-884c-47ae-b291-f2a3932735f7-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-a68b42dd-ffd4-4995-a69f-f2827d3bcc60-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-a68b42dd-ffd4-4995-a69f-f2827d3bcc60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-3a85f912-3637-4e20-903b-583516633f88" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a85f912-3637-4e20-903b-583516633f88" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-a68b42dd-ffd4-4995-a69f-f2827d3bcc60" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-a68b42dd-ffd4-4995-a69f-f2827d3bcc60" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot a68b42dd-ffd4-4995-a69f-f2827d3bcc60 of volume 3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9cf251-b244-4f6d-a18e-2c7803ca54d5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:17 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.321s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:17 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Deleted volume successfully. Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e14cd82c-d293-4b77-9e6c-d0ca47e9c34b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-3dbdd2c3-892c-45f1-82d3-bd60f7585371-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:17 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 Nov 05 12:19:17 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:17 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60" returned: 0 in 0.394s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a85f912-3637-4e20-903b-583516633f88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb5d991-c566-4f12-9a2b-1dbf021c72b5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:17 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:17 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 Nov 05 12:19:17 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:18 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88" returned: 0 in 0.611s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:18 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 Nov 05 12:19:18 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (a386a2de-33fa-4334-9ec0-29237dd401df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e5e8c5-6407-42d1-b79a-829cedf5846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e5e8c5-6407-42d1-b79a-829cedf5846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623297777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eea0d53-ab88-431b-a4a5-25c681e4127e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:19Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844d46eb-a059-42b2-a86f-1e595e792149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844d46eb-a059-42b2-a86f-1e595e792149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ed406d-8192-4f56-9b05-14f0b9742911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ed406d-8192-4f56-9b05-14f0b9742911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eea0d53-ab88-431b-a4a5-25c681e4127e', 'volume_name': 'volume-0eea0d53-ab88-431b-a4a5-25c681e4127e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87393e0f-eddb-4c02-b623-85e75833a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87393e0f-eddb-4c02-b623-85e75833a42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d471165-959d-4d7d-8b6c-7f063e6063f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:18 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Volume 0eea0d53-ab88-431b-a4a5-25c681e4127e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eea0d53-ab88-431b-a4a5-25c681e4127e', 'volume_size': 1} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623297777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eea0d53-ab88-431b-a4a5-25c681e4127e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:19Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Creating volume 0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:18 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:18 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e 1073741824 Nov 05 12:19:18 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:18 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60" returned: 0 in 0.575s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:18 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:18 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60 Nov 05 12:19:18 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:19 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88.a68b42dd-ffd4-4995-a69f-f2827d3bcc60" returned: 0 in 0.282s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-a68b42dd-ffd4-4995-a69f-f2827d3bcc60" released by "_delete_snapshot" :: held 2.008s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a85f912-3637-4e20-903b-583516633f88" released by "delete_snapshot" :: held 2.037s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Created reservations ['25d0746a-7768-4b1f-bb29-8ebf50c41472', '3e078a41-1e36-466d-8ba2-6e5eb3c998b4', '8939e426-c7aa-4d54-bb0f-a3cafc502da8', 'd7045a9b-3130-4e68-a14f-37b14341e361'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:19 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-57a47f7e-0322-453b-8f3e-ad41d35de24b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-a68b42dd-ffd4-4995-a69f-f2827d3bcc60-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:19 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e 1073741824" returned: 0 in 0.716s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:19 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e Nov 05 12:19:19 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:19 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e" returned: 0 in 0.299s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d471165-959d-4d7d-8b6c-7f063e6063f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eea0d53-ab88-431b-a4a5-25c681e4127e', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8019fb-15c3-4b7d-9a87-9f252f7d032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:19 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Volume volume-0eea0d53-ab88-431b-a4a5-25c681e4127e (0eea0d53-ab88-431b-a4a5-25c681e4127e): created successfully Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8019fb-15c3-4b7d-9a87-9f252f7d032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:19 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (a386a2de-33fa-4334-9ec0-29237dd401df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:20 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-38cd09a6-542f-4d85-a743-04619d6b02fd tempest-ProjectReaderTests-1345879390 None] Created volume successfully. Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-3a85f912-3637-4e20-903b-583516633f88-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-3a85f912-3637-4e20-903b-583516633f88-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-3a85f912-3637-4e20-903b-583516633f88" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a85f912-3637-4e20-903b-583516633f88" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b201ec1-f5ef-4d7e-9186-21be63bdc407]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:20 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 Nov 05 12:19:20 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:20 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Creating offline snapshot b65dd6eb-c20e-46d7-8e71-69667e3bce71 of volume 0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:21 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88" returned: 0 in 0.394s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b57ae8-a312-4a81-9aea-87f3396c507d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:21 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88 Nov 05 12:19:21 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:21 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e Nov 05 12:19:21 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:21 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-3a85f912-3637-4e20-903b-583516633f88" returned: 0 in 0.248s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3a85f912-3637-4e20-903b-583516633f88" released by "delete_volume" :: held 0.700s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Created reservations ['559c4971-46d2-42e8-8043-f00e9e2a1812', 'f36cb381-2947-4968-8943-a4a8eeada72b', '2524465f-2dae-454c-b1e8-253c92961057', 'def75e90-9dd4-4047-ad31-d2b680b1bfa1'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:21 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e" returned: 0 in 0.383s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:21 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:21 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:21 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 1G Nov 05 12:19:21 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:21 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.263s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:21 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c73c3c27-50c6-4974-afcc-97db2f3cf4e4 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-3a85f912-3637-4e20-903b-583516633f88-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:21 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 1G" returned: 0 in 0.441s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:21 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eea0d53-ab88-431b-a4a5-25c681e4127e -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:21 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eea0d53-ab88-431b-a4a5-25c681e4127e -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 Nov 05 12:19:21 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:22 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eea0d53-ab88-431b-a4a5-25c681e4127e -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71" returned: 0 in 0.311s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:22 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 is being set with open permissions: ugo+rw Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:22 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 Nov 05 12:19:22 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (617e33e5-16d9-48d8-b0d7-d8e740ae7340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f53eaf-65b3-4b98-89e7-e8c6af633bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f53eaf-65b3-4b98-89e7-e8c6af633bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666716594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:22Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c38af1-442c-4f03-8dc9-90a1db4b47f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c38af1-442c-4f03-8dc9-90a1db4b47f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c83057f-5aa4-4ac2-9763-f3f797f516e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c83057f-5aa4-4ac2-9763-f3f797f516e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5', 'volume_name': 'volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ad0f1a-734d-4a07-8596-6b7917e67558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ad0f1a-734d-4a07-8596-6b7917e67558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb95b41-1da9-4c2e-912f-4fe79f0ed681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:22 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Volume 5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5', 'volume_size': 1} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:22 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71" returned: 0 in 0.239s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:22 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.info Nov 05 12:19:22 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:22 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.info" returned: 0 in 0.238s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:22 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.info is being set with open permissions: ugo+rw Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:22 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.info Nov 05 12:19:22 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:22 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.info" returned: 0 in 0.234s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666716594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:22Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Creating volume 5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:22 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:22 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:22 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 1073741824 Nov 05 12:19:22 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:22 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ed274d65-8b38-48ff-a4ff-44987493631a tempest-ProjectReaderTests-1345879390 None] Create snapshot completed successfully Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-b65dd6eb-c20e-46d7-8e71-69667e3bce71-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Lock "cinder-b65dd6eb-c20e-46d7-8e71-69667e3bce71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-0eea0d53-ab88-431b-a4a5-25c681e4127e" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-0eea0d53-ab88-431b-a4a5-25c681e4127e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-b65dd6eb-c20e-46d7-8e71-69667e3bce71" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-b65dd6eb-c20e-46d7-8e71-69667e3bce71" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Deleting offline snapshot b65dd6eb-c20e-46d7-8e71-69667e3bce71 of volume 0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] snapshot_file for this snap is: volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d5212-9bf2-4b15-a067-c8bc35f6fe91]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:23 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 Nov 05 12:19:23 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:23 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 1073741824" returned: 0 in 0.452s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:23 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 Nov 05 12:19:23 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:23 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71" returned: 0 in 0.362s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eea0d53-ab88-431b-a4a5-25c681e4127e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce9a691-3150-4cc3-8d88-96812dbe51cb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:23 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" returned: 0 in 0.259s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb95b41-1da9-4c2e-912f-4fe79f0ed681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4817309b-407c-4a3e-be03-c16347a53970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:23 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Volume volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 (5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5): created successfully Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4817309b-407c-4a3e-be03-c16347a53970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (617e33e5-16d9-48d8-b0d7-d8e740ae7340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:23 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e Nov 05 12:19:23 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:23 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c864a25f-79bd-4715-b8ba-94db66364ae6 tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:19:23 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e" returned: 0 in 0.366s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:23 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:24 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 Nov 05 12:19:24 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:24 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71" returned: 0 in 0.346s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:24 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71 Nov 05 12:19:24 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot 3f42138a-d8a2-45c9-b489-862ce521b64d of volume 5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ee9007-11c5-46f6-99ed-9890af0ccb1e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:24 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 Nov 05 12:19:24 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:24 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e.b65dd6eb-c20e-46d7-8e71-69667e3bce71" returned: 0 in 0.276s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-b65dd6eb-c20e-46d7-8e71-69667e3bce71" released by "_delete_snapshot" :: held 1.444s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-0eea0d53-ab88-431b-a4a5-25c681e4127e" released by "delete_snapshot" :: held 1.465s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Created reservations ['05e8a842-2f4d-4158-a6d6-a32dc0408b9b', '439736a9-9419-4211-b0f0-8106e155cce3', 'ca9c91a3-c88a-45fb-bb94-61ccfddd4b74', '377a3dfe-c655-43d8-9a70-fdaa1c086a23'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:24 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Delete snapshot completed successfully. Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-7e7f199e-c1d8-49a9-89b3-18b75036977e tempest-ProjectReaderTests-1345879390 None] Lock "cinder-b65dd6eb-c20e-46d7-8e71-69667e3bce71-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:24 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" returned: 0 in 0.374s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:24 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:24 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d 1G Nov 05 12:19:24 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:25 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d 1G" returned: 0 in 0.379s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:25 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d Nov 05 12:19:25 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-0eea0d53-ab88-431b-a4a5-25c681e4127e-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-0eea0d53-ab88-431b-a4a5-25c681e4127e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-0eea0d53-ab88-431b-a4a5-25c681e4127e" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-0eea0d53-ab88-431b-a4a5-25c681e4127e" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1b3ed-2cd7-4d7a-be67-a28b69449f89]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:25 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d" returned: 0 in 0.291s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:25 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d is being set with open permissions: ugo+rw Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:25 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d Nov 05 12:19:25 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:25 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e Nov 05 12:19:25 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:25 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d" returned: 0 in 0.252s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:25 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:25 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:25 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.info Nov 05 12:19:25 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:25 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e Nov 05 12:19:25 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:26 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.info" returned: 0 in 0.266s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:26 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.info is being set with open permissions: ugo+rw Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:26 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0eea0d53-ab88-431b-a4a5-25c681e4127e" returned: 0 in 0.258s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:26 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.info Nov 05 12:19:26 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-0eea0d53-ab88-431b-a4a5-25c681e4127e" released by "delete_volume" :: held 0.705s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Created reservations ['54a4dfc7-5d57-41da-9d24-5bd3aa3fac16', 'fd74d257-0151-4843-97ba-3acb2438a6b4', 'f92c0c30-d715-432e-9817-d306c37a1587', 'c674e19c-0e31-4d7c-aa41-ae51efc86c48'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:26 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:26 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:26 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.info" returned: 0 in 0.239s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-54a2b1d8-2f50-49e5-aaa4-61d140784313 tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:19:26 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.266s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:26 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Deleted volume successfully. Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-72dc733e-8c02-4c73-8d8c-d6f1731fa177 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-0eea0d53-ab88-431b-a4a5-25c681e4127e-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-3f42138a-d8a2-45c9-b489-862ce521b64d-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-3f42138a-d8a2-45c9-b489-862ce521b64d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-3f42138a-d8a2-45c9-b489-862ce521b64d" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3f42138a-d8a2-45c9-b489-862ce521b64d" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot 3f42138a-d8a2-45c9-b489-862ce521b64d of volume 5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41410f-a6d7-4f89-92c1-8ea2edad5315]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:26 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d Nov 05 12:19:26 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (ed049687-abca-49f3-910e-4bf73005006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe51a7ea-7315-4432-b0ec-80a40ed87c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe51a7ea-7315-4432-b0ec-80a40ed87c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585902301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3c6462-01c0-4fa6-b4e1-06d975b4d846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:27Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5b8686-70ea-4933-b19b-bc51dbb512dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5b8686-70ea-4933-b19b-bc51dbb512dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fc64e5-1d6e-43e1-9d70-059a103ce032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fc64e5-1d6e-43e1-9d70-059a103ce032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3c6462-01c0-4fa6-b4e1-06d975b4d846', 'volume_name': 'volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:26 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe9fceb-1bc9-4e7b-a9ec-5c4f1c7a7811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe9fceb-1bc9-4e7b-a9ec-5c4f1c7a7811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a326df57-f27a-41ea-8bf4-46cb22950f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:27 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Volume 8e3c6462-01c0-4fa6-b4e1-06d975b4d846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846', 'volume_size': 1} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585902301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3c6462-01c0-4fa6-b4e1-06d975b4d846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:27Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Creating volume 8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:27 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:27 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 1073741824 Nov 05 12:19:27 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:27 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d" returned: 0 in 0.386s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[81654dbf-7521-45e9-a49d-1cea3e415080]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:27 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 Nov 05 12:19:27 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:27 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 1073741824" returned: 0 in 0.413s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:27 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" returned: 0 in 0.368s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:27 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 Nov 05 12:19:27 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:27 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d Nov 05 12:19:27 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:27 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" returned: 0 in 0.239s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a326df57-f27a-41ea-8bf4-46cb22950f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46288408-8e17-46b8-a505-b76e2c40a15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:27 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Volume volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 (8e3c6462-01c0-4fa6-b4e1-06d975b4d846): created successfully Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46288408-8e17-46b8-a505-b76e2c40a15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (ed049687-abca-49f3-910e-4bf73005006f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:27 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-2427feec-af81-4745-8582-473fec67b1d8 tempest-ProjectReaderTests-1345879390 None] Created volume successfully. Nov 05 12:19:27 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d" returned: 0 in 0.352s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:27 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:27 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d Nov 05 12:19:27 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:28 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5.3f42138a-d8a2-45c9-b489-862ce521b64d" returned: 0 in 0.263s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Creating offline snapshot 45f842f6-6f2f-4963-9887-e7945b7d3834 of volume 8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-3f42138a-d8a2-45c9-b489-862ce521b64d" released by "_delete_snapshot" :: held 1.486s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" released by "delete_snapshot" :: held 1.563s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd29a4f-5170-4c16-a612-5d8f15e149fb]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Created reservations ['f11f7639-fc81-4e8c-9a90-b75306cb013d', 'e7502f56-1921-4150-af5c-edde9cf38453', '7876f258-25e8-4685-a317-9732b01d6074', 'dacfcac5-254d-4ac4-85c3-561e18637e4f'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:28 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 Nov 05 12:19:28 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:28 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c86c1df6-d916-458f-a4b0-b6f1bd33cb41 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-3f42138a-d8a2-45c9-b489-862ce521b64d-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:28 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" returned: 0 in 0.350s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:28 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 1G Nov 05 12:19:28 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec9f7ce-c167-41a0-9587-980b97f9e185]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:28 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 1G" returned: 0 in 0.458s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:28 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:28 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 Nov 05 12:19:28 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:28 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 Nov 05 12:19:28 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:29 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" returned: 0 in 0.392s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:29 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834" returned: 0 in 0.292s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:29 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 is being set with open permissions: ugo+rw Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:29 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5 Nov 05 12:19:29 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:29 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 Nov 05 12:19:29 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:29 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" returned: 0 in 0.254s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:29 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834" returned: 0 in 0.249s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5" released by "delete_volume" :: held 0.717s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:29 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.info Nov 05 12:19:29 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Created reservations ['aafb1a1b-ca71-47cd-bb69-ff1c45142c74', 'ae533958-1aac-4f45-a888-1bddcb722125', '0962f442-a95f-4b90-9c58-93557ad4ebdf', '2c7ed873-7278-4947-a608-7040179a054e'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:29 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:29 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:29 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.info" returned: 0 in 0.262s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:29 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.info is being set with open permissions: ugo+rw Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:29 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.info Nov 05 12:19:29 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:29 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.307s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:29 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:19:29 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-217be295-b0c7-4827-8c62-04ab2f93e46b tempest-ProjectMemberTests-2050865409 None] Lock "cinder-5b4cfe6f-ee7d-47a0-a215-71f6ab54cef5-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:30 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.info" returned: 0 in 0.284s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:30 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f4d535d8-b0f1-4628-aac5-e282222ca546 tempest-ProjectReaderTests-1345879390 None] Create snapshot completed successfully Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (4a5eaa23-9089-40fb-9756-d36b5ec47ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af0a429-da08-4d33-b251-d258f8ab18fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af0a429-da08-4d33-b251-d258f8ab18fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74706090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3baa89-26c4-465d-b1d3-c654ae4952f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:30Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2addb204-32df-44a5-becc-0b0b7051f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2addb204-32df-44a5-becc-0b0b7051f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e9885-bbb3-4d9b-a68b-82822f1af94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e9885-bbb3-4d9b-a68b-82822f1af94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3baa89-26c4-465d-b1d3-c654ae4952f6', 'volume_name': 'volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12995c7-22d4-435f-9384-7f927bddeadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12995c7-22d4-435f-9384-7f927bddeadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209cdaa4-bc82-4f34-87f0-ced5195b2cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:30 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Volume 0a3baa89-26c4-465d-b1d3-c654ae4952f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6', 'volume_size': 1} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74706090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3baa89-26c4-465d-b1d3-c654ae4952f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:30Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Creating volume 0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:30 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:30 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 1073741824 Nov 05 12:19:30 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:30 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 1073741824" returned: 0 in 0.404s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:30 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:30 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 Nov 05 12:19:30 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:31 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6" returned: 0 in 0.249s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209cdaa4-bc82-4f34-87f0-ced5195b2cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bada1f5-300b-4c7c-8a00-574698c6f1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:31 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Volume volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 (0a3baa89-26c4-465d-b1d3-c654ae4952f6): created successfully Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bada1f5-300b-4c7c-8a00-574698c6f1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (4a5eaa23-9089-40fb-9756-d36b5ec47ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:31 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4d5e5de9-39e1-4d0e-ae33-cc04aa979a04 tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-45f842f6-6f2f-4963-9887-e7945b7d3834-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Lock "cinder-45f842f6-6f2f-4963-9887-e7945b7d3834-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-45f842f6-6f2f-4963-9887-e7945b7d3834" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-45f842f6-6f2f-4963-9887-e7945b7d3834" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Deleting offline snapshot 45f842f6-6f2f-4963-9887-e7945b7d3834 of volume 8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] snapshot_file for this snap is: volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8d207d-a368-44a7-a67a-db7500d845c4]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:31 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 Nov 05 12:19:31 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot 1df442bf-11b8-434b-a75b-247c343fe688 of volume 0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e9f2d6-334d-44b6-8356-f0ba2fffcf58]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:31 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:31 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:31 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[362dfea9-a737-4886-8ad8-029ac135d919]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:31 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 Nov 05 12:19:31 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:31 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6" returned: 0 in 0.371s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:31 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:31 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 1G Nov 05 12:19:31 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:32 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" returned: 0 in 0.378s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:32 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 Nov 05 12:19:32 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:32 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 1G" returned: 0 in 0.426s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:32 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 Nov 05 12:19:32 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:32 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834" returned: 0 in 0.357s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:32 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834 Nov 05 12:19:32 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:32 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688" returned: 0 in 0.294s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:32 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 is being set with open permissions: ugo+rw Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:32 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 Nov 05 12:19:32 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:32 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846.45f842f6-6f2f-4963-9887-e7945b7d3834" returned: 0 in 0.260s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-45f842f6-6f2f-4963-9887-e7945b7d3834" released by "_delete_snapshot" :: held 1.468s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" released by "delete_snapshot" :: held 1.491s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Created reservations ['3b45184b-d9d9-42a2-af9d-1ef2c7d37f02', '220afa84-a0f7-4696-938a-5b5ff17860fa', '721db5c9-e537-4914-bd8c-93de58a0acfe', '92056068-a79d-4007-9b2d-cff965c19659'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:32 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Delete snapshot completed successfully. Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-bdcbb60d-99c7-4380-977e-2ef46d9599ba tempest-ProjectReaderTests-1345879390 None] Lock "cinder-45f842f6-6f2f-4963-9887-e7945b7d3834-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:32 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688" returned: 0 in 0.243s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:32 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:32 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.info Nov 05 12:19:32 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:33 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.info" returned: 0 in 0.248s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:33 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.info is being set with open permissions: ugo+rw Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:33 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.info Nov 05 12:19:33 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-8e3c6462-01c0-4fa6-b4e1-06d975b4d846-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-8e3c6462-01c0-4fa6-b4e1-06d975b4d846-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:33 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.info" returned: 0 in 0.259s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:33 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f807b419-4dd6-4ea5-9290-52102f6f6867 tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[c735cf60-4137-40cc-a918-ffe9d3435971]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:33 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 Nov 05 12:19:33 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-1df442bf-11b8-434b-a75b-247c343fe688-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-1df442bf-11b8-434b-a75b-247c343fe688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-0a3baa89-26c4-465d-b1d3-c654ae4952f6" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-0a3baa89-26c4-465d-b1d3-c654ae4952f6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-1df442bf-11b8-434b-a75b-247c343fe688" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-1df442bf-11b8-434b-a75b-247c343fe688" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot 1df442bf-11b8-434b-a75b-247c343fe688 of volume 0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af5ffa7-5037-46ea-ade0-26079a2cd76e]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:33 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 Nov 05 12:19:33 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:33 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" returned: 0 in 0.373s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:33 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:33 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846 Nov 05 12:19:33 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:34 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688" returned: 0 in 0.377s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:34 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" returned: 0 in 0.274s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530768e-9491-4b54-b073-5e31affe1061]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-8e3c6462-01c0-4fa6-b4e1-06d975b4d846" released by "delete_volume" :: held 0.721s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Created reservations ['f8fc8435-2528-42b1-ac35-d83454c7a523', 'a8da9b31-fdb1-4521-bbd6-e3eeffc99dfd', 'f25fc1c1-6063-474c-96f7-93736d59f2b4', 'de515812-d3be-40eb-a047-58da5bf21b12'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:34 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 Nov 05 12:19:34 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:34 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:34 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:34 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6" returned: 0 in 0.390s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:34 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.266s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:34 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Deleted volume successfully. Nov 05 12:19:34 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 Nov 05 12:19:34 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:34 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-dedab1d0-fc92-4189-8cc0-2b5d259118a8 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-8e3c6462-01c0-4fa6-b4e1-06d975b4d846-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:34 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688" returned: 0 in 0.408s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:35 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688 Nov 05 12:19:35 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (76257892-8005-4115-ae46-d950d3a5cea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b3f470-e4fb-4b8f-8c8d-1f3d09999f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b3f470-e4fb-4b8f-8c8d-1f3d09999f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713632626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3529b4-a8ae-42cd-bd69-d6bcd847e960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:35Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bee71b-b9bf-4d9a-a625-9e340497c79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bee71b-b9bf-4d9a-a625-9e340497c79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb086e1f-2ab6-4935-81fe-df52c4a2be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb086e1f-2ab6-4935-81fe-df52c4a2be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3529b4-a8ae-42cd-bd69-d6bcd847e960', 'volume_name': 'volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c207e81-68cc-4ede-81e8-781655a7e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c207e81-68cc-4ede-81e8-781655a7e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7a12d4-e179-43c7-84b2-9f668903038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:35 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Volume ac3529b4-a8ae-42cd-bd69-d6bcd847e960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960', 'volume_size': 1} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713632626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3529b4-a8ae-42cd-bd69-d6bcd847e960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddb95ce0815463d95e9a105f71e2c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:35Z,use_quota=True,user_id='6128e4b42ada406aa06dc2f054e07a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Creating volume ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:35 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:35 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 1073741824 Nov 05 12:19:35 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:35 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6.1df442bf-11b8-434b-a75b-247c343fe688" returned: 0 in 0.258s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-1df442bf-11b8-434b-a75b-247c343fe688" released by "_delete_snapshot" :: held 1.538s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-0a3baa89-26c4-465d-b1d3-c654ae4952f6" released by "delete_snapshot" :: held 1.564s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Created reservations ['de07fbc9-73ab-4663-a502-9a6712d7a655', 'fda2d01d-e0d0-4391-8d2b-d7d48bc9029f', '6dfe49a4-3ee4-45c4-9cab-3a112355ef98', '78d6e5a0-b6a5-41e0-9ee9-909ea915fa3b'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:35 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-1e197fb6-32ce-413e-b5c6-f0d62b4f42c3 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-1df442bf-11b8-434b-a75b-247c343fe688-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:35 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 1073741824" returned: 0 in 0.409s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:35 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 Nov 05 12:19:35 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:35 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" returned: 0 in 0.252s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-0a3baa89-26c4-465d-b1d3-c654ae4952f6-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7a12d4-e179-43c7-84b2-9f668903038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6379a8-66e7-40b0-8bbf-f7938e45df13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-0a3baa89-26c4-465d-b1d3-c654ae4952f6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:35 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Volume volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 (ac3529b4-a8ae-42cd-bd69-d6bcd847e960): created successfully Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6379a8-66e7-40b0-8bbf-f7938e45df13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Flow 'volume_create_manager' (76257892-8005-4115-ae46-d950d3a5cea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:35 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f79c50d8-1dc9-478f-968b-e8d654bf19b2 tempest-ProjectReaderTests-1345879390 None] Created volume successfully. Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-0a3baa89-26c4-465d-b1d3-c654ae4952f6" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:35 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-0a3baa89-26c4-465d-b1d3-c654ae4952f6" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[504433cc-f3ee-4cf3-b790-f7e6cc011747]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:36 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 Nov 05 12:19:36 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Creating offline snapshot e9b4a2e6-1a42-432a-bb82-1925a48c286f of volume ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2aa66a-d7c5-4272-816f-e772246af453]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:36 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 Nov 05 12:19:36 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:36 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6" returned: 0 in 0.373s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:36 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6 Nov 05 12:19:36 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:36 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" returned: 0 in 0.364s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:36 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f 1G Nov 05 12:19:36 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:36 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-0a3baa89-26c4-465d-b1d3-c654ae4952f6" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-0a3baa89-26c4-465d-b1d3-c654ae4952f6" released by "delete_volume" :: held 0.696s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Created reservations ['1df12e30-5b23-4249-8933-822000a31a6b', 'aaf67c8c-6ac0-4ae9-85a4-c810941dc7c1', 'c87f3c7d-625c-4f04-b67f-25fe4cdf2096', 'e2040402-d821-45fc-81a2-4c541436b0b6'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:36 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:36 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:36 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:37 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:37 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.277s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f 1G" returned: 0 in 0.451s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:37 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:19:37 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f Nov 05 12:19:37 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c0c6fd8a-9498-4a0d-b385-82e0663d6c22 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-0a3baa89-26c4-465d-b1d3-c654ae4952f6-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:37 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f" returned: 0 in 0.347s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:37 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f is being set with open permissions: ugo+rw Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:37 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f Nov 05 12:19:37 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (fb6d0b78-1cfd-46f4-a944-9b9ce15a686f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6881178-6ed7-46e7-b0e7-85b61f1c04dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6881178-6ed7-46e7-b0e7-85b61f1c04dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1617420724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:37Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e60629-8368-4ca0-ad86-00d9b72bc6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e60629-8368-4ca0-ad86-00d9b72bc6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d3cc2f-21d8-4491-b7bd-5e2c5005f95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d3cc2f-21d8-4491-b7bd-5e2c5005f95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b', 'volume_name': 'volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb39804-61c4-47ba-b5f4-6fc21de66c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb39804-61c4-47ba-b5f4-6fc21de66c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dfb071-8168-44ee-a7b8-b39583cf2ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:37 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Volume 5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b', 'volume_size': 1} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:37 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f" returned: 0 in 0.242s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:37 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.info Nov 05 12:19:37 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:37 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.info" returned: 0 in 0.252s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:37 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.info is being set with open permissions: ugo+rw Nov 05 12:19:37 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:37 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.info Nov 05 12:19:37 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:38 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.info" returned: 0 in 0.247s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1617420724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:37Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Creating volume 5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:38 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:38 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b 1073741824 Nov 05 12:19:38 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-0a06d49c-3ed4-493f-902c-b8ed06343094 tempest-ProjectReaderTests-1345879390 None] Create snapshot completed successfully Nov 05 12:19:38 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b 1073741824" returned: 0 in 0.408s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:38 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b Nov 05 12:19:38 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:38 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" returned: 0 in 0.244s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dfb071-8168-44ee-a7b8-b39583cf2ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb3d58-f400-41b5-af09-da1ac27ad0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:38 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Volume volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b (5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b): created successfully Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb3d58-f400-41b5-af09-da1ac27ad0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:38 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (fb6d0b78-1cfd-46f4-a944-9b9ce15a686f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:38 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e2716015-edde-47f0-be57-9a415d7c7fa4 tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-e9b4a2e6-1a42-432a-bb82-1925a48c286f-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-e9b4a2e6-1a42-432a-bb82-1925a48c286f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-e9b4a2e6-1a42-432a-bb82-1925a48c286f" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-e9b4a2e6-1a42-432a-bb82-1925a48c286f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Deleting offline snapshot e9b4a2e6-1a42-432a-bb82-1925a48c286f of volume ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] snapshot_file for this snap is: volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de6b32-82b9-4bbd-9f86-b46211c55b01]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:39 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f Nov 05 12:19:39 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:UPDATE=228,cinder:DELETE=16,cinder:SELECT=182,cinder:INSERT=65 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot f8347c20-0873-4299-a453-54ab37cfb6c4 of volume 5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75aceea-b045-4713-86dd-ce7a2579a8d5]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:39 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f" returned: 0 in 0.382s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f74216-a561-4a9c-8bd2-11f1f445aa1b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:39 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:39 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b Nov 05 12:19:39 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:39 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 Nov 05 12:19:39 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:40 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" returned: 0 in 0.379s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:40 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 1G Nov 05 12:19:40 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:40 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:40 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f Nov 05 12:19:40 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:40 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f" returned: 0 in 0.332s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:40 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 1G" returned: 0 in 0.424s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:40 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f Nov 05 12:19:40 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:40 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 Nov 05 12:19:40 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:40 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960.e9b4a2e6-1a42-432a-bb82-1925a48c286f" returned: 0 in 0.264s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-e9b4a2e6-1a42-432a-bb82-1925a48c286f" released by "_delete_snapshot" :: held 1.450s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" released by "delete_snapshot" :: held 1.472s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:40 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4" returned: 0 in 0.310s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:40 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 is being set with open permissions: ugo+rw Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:40 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 Nov 05 12:19:40 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:40 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Created reservations ['5caa5599-8457-445f-8f7e-207b8abc2b2b', '0da507ec-f01f-45fe-a46a-5826a84a361b', 'c3a076a9-29bf-44ab-a425-42accb7d3887', 'ea2b1bcf-7578-40ae-93ec-2cff2bcdeab4'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Delete snapshot completed successfully. Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f92e4bfa-ae12-4045-9904-3a0584e03233 tempest-ProjectReaderTests-1345879390 None] Lock "cinder-e9b4a2e6-1a42-432a-bb82-1925a48c286f-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:41 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4" returned: 0 in 0.256s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:41 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.info Nov 05 12:19:41 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:41 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.info" returned: 0 in 0.248s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:41 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.info is being set with open permissions: ugo+rw Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:41 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.info Nov 05 12:19:41 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-ac3529b4-a8ae-42cd-bd69-d6bcd847e960-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-ac3529b4-a8ae-42cd-bd69-d6bcd847e960-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=198,cinder:INSERT=67,cinder:UPDATE=268,cinder:DELETE=28 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Acquiring lock "cinder-quobyte-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b906f6-60aa-469f-ae68-2990ed7ee575]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:41 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.info" returned: 0 in 0.268s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:41 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-b033a75b-12dd-460e-859f-3e814392ac2a tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:19:41 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 Nov 05 12:19:41 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-f8347c20-0873-4299-a453-54ab37cfb6c4-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-f8347c20-0873-4299-a453-54ab37cfb6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-f8347c20-0873-4299-a453-54ab37cfb6c4" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-f8347c20-0873-4299-a453-54ab37cfb6c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot f8347c20-0873-4299-a453-54ab37cfb6c4 of volume 5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22b0fc-67dd-4e21-97c9-0ef94e774601]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:41 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:42 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" returned: 0 in 0.390s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:42 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960 Nov 05 12:19:42 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:42 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 Nov 05 12:19:42 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:42 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" returned: 0 in 0.263s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-quobyte-ac3529b4-a8ae-42cd-bd69-d6bcd847e960" released by "delete_volume" :: held 0.711s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:42 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4" returned: 0 in 0.391s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fb42a1-9be5-4958-ba13-f5189451f064]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Created reservations ['9a7b3045-2858-42c9-8dfa-c921b2b0909c', 'aca66741-290b-4689-b1b6-581a11baa364', 'c7f80483-2800-4f1c-bfde-0c66adcb9c70', 'f4edf355-6621-4696-93be-66d48b6263ee'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:42 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b Nov 05 12:19:42 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:42 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:42 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:42 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.270s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:42 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Deleted volume successfully. Nov 05 12:19:42 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" returned: 0 in 0.387s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:42 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c747c06e-6b06-4a2d-b502-f7154596b99b tempest-ProjectReaderTests-1345879390 None] Lock "cinder-ac3529b4-a8ae-42cd-bd69-d6bcd847e960-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:42 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 Nov 05 12:19:42 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:43 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4" returned: 0 in 0.385s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:43 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4 Nov 05 12:19:43 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:43 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:43 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b.f8347c20-0873-4299-a453-54ab37cfb6c4" returned: 0 in 0.268s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-f8347c20-0873-4299-a453-54ab37cfb6c4" released by "_delete_snapshot" :: held 1.529s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" released by "delete_snapshot" :: held 1.551s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:43 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Created reservations ['67950f5d-dd7b-4b50-86ad-7e900ed306ba', 'a45754f3-5088-438a-b2e0-e9be8d9a32d0', 'e2e9ad08-0b76-4249-a0fb-70d087e0cea5', '98c712a9-83dc-404b-bf77-aaa3b574b1d5'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:43 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:19:43 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e4fc0c65-4f79-4477-b30a-99717f5c288a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-f8347c20-0873-4299-a453-54ab37cfb6c4-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" acquired by "delete_volume" :: waited 0.021s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c2001-3784-4bfc-889b-1b38bdb08fe2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:44 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b Nov 05 12:19:44 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:44 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" returned: 0 in 0.375s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:44 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b Nov 05 12:19:44 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:44 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" returned: 0 in 0.254s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b" released by "delete_volume" :: held 0.716s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Created reservations ['53557c45-2001-428e-8765-4a1192548fa0', '5a061f4d-55d4-41d4-998a-64206c765490', 'f456c8a8-b1a0-4669-8f87-11dc5db02357', 'e0e37223-67ef-4f19-bebd-bfe5f30f7bac'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:44 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:45 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:45 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:45 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.276s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:45 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-60f1772d-46f3-4472-96d5-627ee7c459a5 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-5ea8e21d-3e1d-46d6-964c-ecce5d8e3b3b-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (a8a243ed-2ac0-4cd8-a79e-0407cf3a5f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d281173-20f4-40f7-8df5-7ab1ce85747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d281173-20f4-40f7-8df5-7ab1ce85747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1873840936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:46Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc4267f-29cd-4222-86a6-35d1365ae665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc4267f-29cd-4222-86a6-35d1365ae665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801d0e9a-1545-4d4e-ad18-334346e42aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801d0e9a-1545-4d4e-ad18-334346e42aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea', 'volume_name': 'volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b255e0c-12d4-47c0-a470-59671bea8f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b255e0c-12d4-47c0-a470-59671bea8f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1be0d69-256b-4d08-a438-63db6ebd322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:45 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Volume adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea', 'volume_size': 1} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1873840936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:46Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Creating volume adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:45 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:45 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:45 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea 1073741824 Nov 05 12:19:45 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:46 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea 1073741824" returned: 0 in 0.454s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:46 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea Nov 05 12:19:46 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:46 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" returned: 0 in 0.261s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1be0d69-256b-4d08-a438-63db6ebd322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24997018-6cfc-4418-b3ed-56e31183d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:46 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Volume volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea (adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea): created successfully Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24997018-6cfc-4418-b3ed-56e31183d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:46 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (a8a243ed-2ac0-4cd8-a79e-0407cf3a5f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:46 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ff4b105b-c9bb-4f29-9df5-8a56980ed15d tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:19:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:47 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:47 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot ced034be-10ab-4fb6-86ef-146efafc25a9 of volume adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:48 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43e4b1-0624-47a4-b26a-867f8488ebc2]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:48 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea Nov 05 12:19:48 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:48 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" returned: 0 in 0.399s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:48 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 1G Nov 05 12:19:48 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:48 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 1G" returned: 0 in 0.398s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:48 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:48 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 Nov 05 12:19:48 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:49 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9" returned: 0 in 0.278s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:49 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 is being set with open permissions: ugo+rw Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:49 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 Nov 05 12:19:49 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:49 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:49 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.info Nov 05 12:19:49 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:49 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.info" returned: 0 in 0.248s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:49 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.info is being set with open permissions: ugo+rw Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:49 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.info Nov 05 12:19:49 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:49 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.info" returned: 0 in 0.257s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:49 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:49 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5d91aba3-3f25-4736-9a7e-78c4d606ead8 tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-ced034be-10ab-4fb6-86ef-146efafc25a9-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-ced034be-10ab-4fb6-86ef-146efafc25a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-ced034be-10ab-4fb6-86ef-146efafc25a9" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-ced034be-10ab-4fb6-86ef-146efafc25a9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot ced034be-10ab-4fb6-86ef-146efafc25a9 of volume adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd04a3db-5c4f-4e28-b547-0405597a160c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:50 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 Nov 05 12:19:50 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:50 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9" returned: 0 in 0.365s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cb2019-3388-41b0-a691-aa5b79a3994f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:50 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:50 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea Nov 05 12:19:50 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:51 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" returned: 0 in 0.366s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:51 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 Nov 05 12:19:51 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:51 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9" returned: 0 in 0.336s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:51 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9 Nov 05 12:19:51 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:51 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea.ced034be-10ab-4fb6-86ef-146efafc25a9" returned: 0 in 0.270s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-ced034be-10ab-4fb6-86ef-146efafc25a9" released by "_delete_snapshot" :: held 1.450s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" released by "delete_snapshot" :: held 1.478s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Created reservations ['3b0164f5-5587-4fd3-9cf7-847e6f4cc01d', '0cefc90c-af58-400c-a7da-658266b57344', '247fe18d-bbf2-4490-b13d-d9ce133d5972', 'a034e5b0-c917-46b4-bd53-ccac2f004f97'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:51 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:19:51 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-ff9c20b8-69a3-4cfd-8e5d-74ff9292f516 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-ced034be-10ab-4fb6-86ef-146efafc25a9-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" acquired by "delete_volume" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f97a77b-5e84-4345-873a-b951c1786303]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:52 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea Nov 05 12:19:52 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:52 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:52 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:52 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.276s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_service.periodic_task [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] Running periodic task VolumeManager._thread_info {{(pid=86942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread count: 28 {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-08c877e1-1f53-4378-a8c4-895ade906bf0 None None] thread info: [<_MainThread(MainThread, started 137036543451264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 12:19:52 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" returned: 0 in 0.425s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:52 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:52 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea Nov 05 12:19:52 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:53 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" returned: 0 in 0.313s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea" released by "delete_volume" :: held 0.814s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Created reservations ['871b87c4-7c05-4d66-8e58-5b218c6846dc', '71beb67f-2ac5-4dcc-adaf-f87a70655e24', '5549c9fd-4218-42a0-9f9e-762ff270c101', '817927c0-76be-47ac-b247-f253ce24e0af'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:53 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:19:53 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:53 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.262s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:19:53 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-e5c557b3-5cfe-4da1-b7fc-616abbb4af4a tempest-ProjectMemberTests-2050865409 None] Lock "cinder-adbd3bf4-3ab5-4c16-8f7b-994b5316a9ea-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:19:53 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (6d52247e-638d-432f-96b3-647ff6ea72aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9e76dd-42d3-42ea-8a51-2039308d6e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9e76dd-42d3-42ea-8a51-2039308d6e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454352511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501d1cbf-9865-4d86-9237-bfd6d999108f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:54Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7704f766-15a1-45ac-8588-c68a8ecd0929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7704f766-15a1-45ac-8588-c68a8ecd0929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e27cf3c-de7b-481a-a07c-27e79c644bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e27cf3c-de7b-481a-a07c-27e79c644bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501d1cbf-9865-4d86-9237-bfd6d999108f', 'volume_name': 'volume-501d1cbf-9865-4d86-9237-bfd6d999108f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1776caa-e07d-4d7f-84d8-96efc5822d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1776caa-e07d-4d7f-84d8-96efc5822d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aa1f29-0dcc-4ffc-8fed-08743f969d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:54 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Volume 501d1cbf-9865-4d86-9237-bfd6d999108f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501d1cbf-9865-4d86-9237-bfd6d999108f', 'volume_size': 1} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454352511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501d1cbf-9865-4d86-9237-bfd6d999108f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c222265f945c6b5620c2157afa5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:19:54Z,use_quota=True,user_id='5dabff6a7c964ea08a845f8ad4a4ac45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Creating volume 501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:19:54 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:54 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f 1073741824 Nov 05 12:19:54 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:54 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f 1073741824" returned: 0 in 0.435s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:54 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f Nov 05 12:19:54 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:54 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f" returned: 0 in 0.259s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aa1f29-0dcc-4ffc-8fed-08743f969d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501d1cbf-9865-4d86-9237-bfd6d999108f', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b6a16e-c25d-432b-a5d1-e9271c308067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:19:54 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Volume volume-501d1cbf-9865-4d86-9237-bfd6d999108f (501d1cbf-9865-4d86-9237-bfd6d999108f): created successfully Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b6a16e-c25d-432b-a5d1-e9271c308067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:19:54 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Flow 'volume_create_manager' (6d52247e-638d-432f-96b3-647ff6ea72aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:19:54 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-7dfaf1a3-ceb3-45b3-946a-34be18032024 tempest-ProjectMemberTests-2050865409 None] Created volume successfully. Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Creating offline snapshot f68634b1-d191-44cd-bfb0-575912e8a283 of volume 501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[af90ddf4-7871-4563-b725-e3e7854ec10d]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:55 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f Nov 05 12:19:55 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:55 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 1G {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:55 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 1G Nov 05 12:19:55 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:55 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 1G" returned: 0 in 0.389s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:55 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501d1cbf-9865-4d86-9237-bfd6d999108f -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:55 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501d1cbf-9865-4d86-9237-bfd6d999108f -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 Nov 05 12:19:55 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:56 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501d1cbf-9865-4d86-9237-bfd6d999108f -F qcow2 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283" returned: 0 in 0.274s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:56 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 is being set with open permissions: ugo+rw Nov 05 12:19:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:56 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 Nov 05 12:19:56 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:56 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283" returned: 0 in 0.244s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:56 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.info Nov 05 12:19:56 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:56 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.info" returned: 0 in 0.273s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:56 devstack cinder-volume[86942]: WARNING cinder.volume.drivers.remotefs [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.info is being set with open permissions: ugo+rw Nov 05 12:19:56 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.info {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:56 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.info Nov 05 12:19:56 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:57 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.info" returned: 0 in 0.271s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:19:57 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-4292186e-ae77-45c8-97f5-72b248c024ea tempest-ProjectMemberTests-2050865409 None] Create snapshot completed successfully Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-f68634b1-d191-44cd-bfb0-575912e8a283-delete_snapshot" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-f68634b1-d191-44cd-bfb0-575912e8a283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-501d1cbf-9865-4d86-9237-bfd6d999108f" by "delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-501d1cbf-9865-4d86-9237-bfd6d999108f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-f68634b1-d191-44cd-bfb0-575912e8a283" by "_delete_snapshot" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-f68634b1-d191-44cd-bfb0-575912e8a283" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Deleting offline snapshot f68634b1-d191-44cd-bfb0-575912e8a283 of volume 501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] snapshot_file for this snap is: volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 {{(pid=86942) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64138d3-2b37-4ba8-a821-356318958f1f]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:57 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 Nov 05 12:19:57 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:57 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283" returned: 0 in 0.357s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-501d1cbf-9865-4d86-9237-bfd6d999108f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86942) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[be73e5d2-c192-42fe-9f70-a4d2e1aa1958]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:57 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:57 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f Nov 05 12:19:57 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:58 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f" returned: 0 in 0.370s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:58 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 Nov 05 12:19:58 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:58 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283" returned: 0 in 0.361s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:58 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283 Nov 05 12:19:58 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:19:58 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f.f68634b1-d191-44cd-bfb0-575912e8a283" returned: 0 in 0.255s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-f68634b1-d191-44cd-bfb0-575912e8a283" released by "_delete_snapshot" :: held 1.454s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-501d1cbf-9865-4d86-9237-bfd6d999108f" released by "delete_snapshot" :: held 1.476s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:58 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Created reservations ['7f730780-70c7-45bb-b307-75de92d88a21', '3c8e5234-9681-4154-abec-aa1251fe1318', '8fb62410-9a5b-4a21-acc6-3d65b4d4c505', '9dbaa3c8-2fe5-4bf7-9a3a-12af6134aeec'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:19:59 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Delete snapshot completed successfully. Nov 05 12:19:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-c804dff5-8522-4843-a46c-2b0b5d1126a2 tempest-ProjectMemberTests-2050865409 None] Lock "cinder-f68634b1-d191-44cd-bfb0-575912e8a283-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:19:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-501d1cbf-9865-4d86-9237-bfd6d999108f-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Lock "cinder-501d1cbf-9865-4d86-9237-bfd6d999108f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Acquiring lock "cinder-quobyte-501d1cbf-9865-4d86-9237-bfd6d999108f" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:19:59 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-501d1cbf-9865-4d86-9237-bfd6d999108f" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:19:59 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[7429c0cf-6593-4489-ab47-f6b2ec59ca2b]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:19:59 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:19:59 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f Nov 05 12:19:59 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:00 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f" returned: 0 in 0.400s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:00 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f Nov 05 12:20:00 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:00 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-501d1cbf-9865-4d86-9237-bfd6d999108f" returned: 0 in 0.249s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Lock "cinder-quobyte-501d1cbf-9865-4d86-9237-bfd6d999108f" released by "delete_volume" :: held 0.738s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Created reservations ['41f5da02-3bd1-4eb0-a254-58e4d4b12ee7', '63916764-6c1f-4149-87a9-28c40afb3bf2', '36c432a2-c201-4327-bb2f-70bcdc1e2916', '822eadb0-395b-4c18-809d-e99f5c29325c'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:00 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:20:00 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:00 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.257s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:20:00 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Deleted volume successfully. Nov 05 12:20:00 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-5aa55119-a67d-46fb-892e-76045287954e tempest-ProjectMemberTests-2050865409 None] Lock "cinder-501d1cbf-9865-4d86-9237-bfd6d999108f-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Flow 'volume_create_manager' (526160f4-3c35-4fb0-a6fd-83295f67b654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b210c-0968-4602-ba15-5647ee752418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b210c-0968-4602-ba15-5647ee752418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749297145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030b1b99-5d29-454e-9e26-624840502934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af7b2cdd3f40ec85c13f3989cfbd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:20:03Z,use_quota=True,user_id='b7c860ccc4a14b33b205e7a9484fd913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c519f8-fca8-4d12-91a3-bba28c886f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c519f8-fca8-4d12-91a3-bba28c886f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79930df-4952-45db-9c4b-0a29554dab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79930df-4952-45db-9c4b-0a29554dab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030b1b99-5d29-454e-9e26-624840502934', 'volume_name': 'volume-030b1b99-5d29-454e-9e26-624840502934', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1f2136-02c5-49e9-9804-f0456307af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1f2136-02c5-49e9-9804-f0456307af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326dc72c-6dbd-4724-8322-7f1aa306305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:02 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Volume 030b1b99-5d29-454e-9e26-624840502934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030b1b99-5d29-454e-9e26-624840502934', 'volume_size': 1} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749297145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030b1b99-5d29-454e-9e26-624840502934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af7b2cdd3f40ec85c13f3989cfbd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:20:03Z,use_quota=True,user_id='b7c860ccc4a14b33b205e7a9484fd913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Creating volume 030b1b99-5d29-454e-9e26-624840502934 {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:20:02 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:20:02 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:02 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 1073741824 Nov 05 12:20:02 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:03 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 1073741824" returned: 0 in 0.428s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:03 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 Nov 05 12:20:03 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:03 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934" returned: 0 in 0.255s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326dc72c-6dbd-4724-8322-7f1aa306305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030b1b99-5d29-454e-9e26-624840502934', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5eab5b9-c022-4efc-8afc-9f68639c085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:03 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Volume volume-030b1b99-5d29-454e-9e26-624840502934 (030b1b99-5d29-454e-9e26-624840502934): created successfully Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5eab5b9-c022-4efc-8afc-9f68639c085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:03 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Flow 'volume_create_manager' (526160f4-3c35-4fb0-a6fd-83295f67b654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:20:03 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-a7d5050b-ce5d-4bb1-b81b-fc1773518f2d tempest-ProjectReaderTests-445406949 None] Created volume successfully. Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Acquiring lock "cinder-030b1b99-5d29-454e-9e26-624840502934-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Lock "cinder-030b1b99-5d29-454e-9e26-624840502934-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Acquiring lock "cinder-quobyte-030b1b99-5d29-454e-9e26-624840502934" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Lock "cinder-quobyte-030b1b99-5d29-454e-9e26-624840502934" acquired by "delete_volume" :: waited 0.016s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[543c84f6-a3b0-4a58-bf4f-401a8adde49c]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:04 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 Nov 05 12:20:04 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:04 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934" returned: 0 in 0.377s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:04 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934 Nov 05 12:20:04 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:04 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-030b1b99-5d29-454e-9e26-624840502934" returned: 0 in 0.266s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Lock "cinder-quobyte-030b1b99-5d29-454e-9e26-624840502934" released by "delete_volume" :: held 0.695s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Created reservations ['619e64df-c7a9-4572-933f-59487af572be', '2870ae02-26d5-4dec-bb09-f4a8a71d4489', 'f4e0b697-83f2-4e8d-8d8d-4303206f121f', 'eb26a2c3-6c11-43a5-9df8-b1071de52eaa'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:20:04 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:04 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:20:04 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:05 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.262s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:20:05 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Deleted volume successfully. Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-f31aa83d-2af6-4f46-b5f5-1a4a32ad6399 tempest-ProjectReaderTests-445406949 None] Lock "cinder-030b1b99-5d29-454e-9e26-624840502934-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86942) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Flow 'volume_create_manager' (d3a6e65f-26a5-44b8-af26-5171b98f5be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599e1fc3-289d-463c-b5ab-60db25e0022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599e1fc3-289d-463c-b5ab-60db25e0022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778887614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07638e78-4342-4def-9d64-f778098d87fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af7b2cdd3f40ec85c13f3989cfbd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:20:06Z,use_quota=True,user_id='b7c860ccc4a14b33b205e7a9484fd913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3c9b53-ba8f-451d-a45f-685aa98c7f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3c9b53-ba8f-451d-a45f-685aa98c7f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a80cdee-2ec2-4f98-acf0-cd14ad0ab223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a80cdee-2ec2-4f98-acf0-cd14ad0ab223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07638e78-4342-4def-9d64-f778098d87fd', 'volume_name': 'volume-07638e78-4342-4def-9d64-f778098d87fd', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244305f6-e50a-4563-acdd-8c36dfe10bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244305f6-e50a-4563-acdd-8c36dfe10bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1391e4-18f9-4208-9cdf-694237259987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:05 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Volume 07638e78-4342-4def-9d64-f778098d87fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07638e78-4342-4def-9d64-f778098d87fd', 'volume_size': 1} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T11:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778887614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07638e78-4342-4def-9d64-f778098d87fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9af7b2cdd3f40ec85c13f3989cfbd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:20:06Z,use_quota=True,user_id='b7c860ccc4a14b33b205e7a9484fd913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c1cd23-a401-4be1-8203-631810abac5c),volume_type_id=b6c1cd23-a401-4be1-8203-631810abac5c)}" {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.remotefs [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Creating volume 07638e78-4342-4def-9d64-f778098d87fd {{(pid=86942) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Selected osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 as target Quobyte volume. {{(pid=86942) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 12:20:05 devstack cinder-volume[86942]: INFO cinder.volume.drivers.remotefs [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] casted to osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9 Nov 05 12:20:05 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd 1073741824 {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:05 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd 1073741824 Nov 05 12:20:05 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:06 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd 1073741824" returned: 0 in 0.477s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:06 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd Nov 05 12:20:06 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:06 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd" returned: 0 in 0.251s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'} {{(pid=86942) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1391e4-18f9-4208-9cdf-694237259987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07638e78-4342-4def-9d64-f778098d87fd', 'volume_size': 1}' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e150285-847b-4c81-9bc6-dd015e043fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 12:20:06 devstack cinder-volume[86942]: INFO cinder.volume.flows.manager.create_volume [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Volume volume-07638e78-4342-4def-9d64-f778098d87fd (07638e78-4342-4def-9d64-f778098d87fd): created successfully Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e150285-847b-4c81-9bc6-dd015e043fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86942) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Flow 'volume_create_manager' (d3a6e65f-26a5-44b8-af26-5171b98f5be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86942) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 12:20:06 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-1eb56a9a-7118-4b0a-8f12-14458f8398f5 tempest-ProjectReaderTests-445406949 None] Created volume successfully. Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Acquiring lock "cinder-07638e78-4342-4def-9d64-f778098d87fd-delete_volume" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Lock "cinder-07638e78-4342-4def-9d64-f778098d87fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Acquiring lock "cinder-quobyte-07638e78-4342-4def-9d64-f778098d87fd" by "delete_volume" {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Lock "cinder-quobyte-07638e78-4342-4def-9d64-f778098d87fd" acquired by "delete_volume" :: waited 0.023s {{(pid=86942) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4956b-6bfc-471d-943f-301cddde2b0a]: (4, 'qcow2') {{(pid=88330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 12:20:06 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:06 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd Nov 05 12:20:06 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:07 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd" returned: 0 in 0.403s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:07 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd Nov 05 12:20:07 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:07 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f/volume-07638e78-4342-4def-9d64-f778098d87fd" returned: 0 in 0.260s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Lock "cinder-quobyte-07638e78-4342-4def-9d64-f778098d87fd" released by "delete_volume" :: held 0.709s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG cinder.quota [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Created reservations ['a7a9d57c-c5b6-4af7-92b2-909811d8a095', 'eb851252-f1e2-4058-942c-21290afba70b', '8f69b6b9-2b85-491b-8b41-def9fcd3ffbd', '90fee590-657f-4da9-93a9-094fe45d81e0'] {{(pid=86942) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9': None} {{(pid=86942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG cinder.volume.drivers.quobyte [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-17be1dbb-e68a-427b-8778-1e0bada432c9'] {{(pid=86942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.lockutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 12:20:07 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f Nov 05 12:20:07 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 12:20:07 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG oslo_concurrency.processutils [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5109f912de67b4705da10f50d94fa43f" returned: 0 in 0.250s {{(pid=86942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG cinder.manager [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Notifying Schedulers of capabilities ... {{(pid=86942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 12:20:07 devstack cinder-volume[86942]: INFO cinder.volume.manager [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Deleted volume successfully. Nov 05 12:20:07 devstack cinder-volume[86942]: DEBUG cinder.coordination [None req-99740e25-2f05-41da-8741-7c08162cf6cc tempest-ProjectReaderTests-445406949 None] Lock "cinder-07638e78-4342-4def-9d64-f778098d87fd-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86942) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 12:20:17 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=60,cinder:INSERT=22,cinder:UPDATE=86,cinder:DELETE=7 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 12:20:17 devstack cinder-volume[86942]: DEBUG dbcounter [-] [86942] Writing DB stats cinder:SELECT=59,cinder:UPDATE=79,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}